The pensioner was walking along Queen Street at about 10.30 am on Monday when a woman in the flat accidentally knocked the vase off the sill while cleaning.
The man was treated at the scene by paramedics before being taken to hospital with what are believed to be minor injuries.
The woman was spoken to by officers.
