If you have the setting "start timer on first input" enabled and you click on the back to game button with your mouse then the timer starts running even if you have not made any inputs in the game