In third person mode, the hat will not be aligned properly when in either of the two described modes.
Not sure what could be causing this, but it certainly looks really strange, especially when playing with anyone else.