You may add illness. When player stays in cold places for too long (e.g. 15 mins+) he gets "flu" effect. It may work like cold sensitivity: You must stay in hotter places or you will get cold.

We've thought about adding illnesses/diseases in the past, but felt it would just complicate the gameplay too much.