That's not a sword. It was sort of like a police officer's badge prior to the fall of the Shogunate. It was also used by guards in places where swords were forbidden.

Since Reimu is sort of like Gensokyo's police force, this does make sense :P