Happened when changing my previously selected profile to my old default profile, then again when when resetting that old profile to default. Once that profile had been reset, the next time I changed it I was prompted for a reload.

Weird it prompts me everytime... I'm not sure what this is about