Go into third person and activate an active spell a few times, sometimes the arm won't raise and sometimes it will raise but not lower back down when releasing the key bind.

Upon investigation, the source of this issue only seems to cause this to happen in a single-player world. Multiplayer behavior is as expected.