I've had a box that just says "swords 100%" on my screen for a while now. I can't make it go away and I can't find out where it's coming from.

It's likely a quest you pinned. Find the quest in the questbook and unpin it with the apposite button