A configuration file, or a way to disable certain (or all) gems in case users only want the affix compatibility.
Just a thought ¯_(ツ)_/¯

Everything can be disabled via datapacks, a config is not planned because of this. If you need help making one, you can bug me in either Shadow's discord or my discord (link on the mod page).