I spent some time looking but I can't seem to be able to find how I can disable jack o lantern mushrooms in the configs.

Ah, sorry for not replying. I've stopped working on the 1.12 version, and a 1.15 version is being developed. There will be a better way to disable things in the config.