Without changing anything, new config files seem to be automatically and constantly created.

Using 1.18.2 forge if it matters

same here- 1.19.2

When exactly is this happening? I'm just using Forge's config system so I'd be surprised if it behaves differently than most mods.

Ill try to take notice of when

I'm getting this issue as well. I believe it is happening ever time the game launches.