I have cloth config and I have the necessary fabric API version, and I am on Fabric loader 0.14.21-1.19.4

This seems to be a commonly reported issue, and, judging by other reports, a side issue not everyone knows about. Referencing the nether sounds report a while ago, that person probably didn't have settings options to know they could manipulate which things play sounds.

Thats cloth config for Forge