Ideally when a new reminder pops up the old one should close. Or maybe they should just be offset so you can at least see you have others open.

This isn't really a problem with daily and weekly reminders as you'd have to leave your UI open for a while for it to matter. But if I were to implement shorter or customizable reminders it could become ugly.