If you're inside of a room with a bunch of cave vines around it will start playing cave sounds despite being nowhere near a cave.

Use the command /ambient-debug. Make a few screenshots of the situation, then I might be able to figure out how the engine can be tweaked.

Fixed in the newest version of AmbientSounds. If the issue still persists make sure to report it back here.

Issue persists. I'll give you a link to where you can download the map so you can test it out for yourself. https://jeracraft.gumroad.com/l/bxjows?layout=profile

Btw the map is made by a very big Minecraft youtuber so you can be sure it's virus free. The issue happens inside the house. near the bottom. The map is free btw. You just have to select 0 euro at the price.