It seems like cave fog also appears when you are at sea level, which makes the sky look very dull when fx in a boat. An option to configure when the fog turns into cave fog would be nice.

This has been addressed in patch 1.1.2, somewhat. Cave fog is now based off the world's heightmap! Might look into this for future releases, though.