I'm not using magic paper(enabled carved pumpkin as a head in config), and it is useless and just hoards if u farm the golems, same with redstone...

The magic paper and redstone are added using loot tables and you can use a datapack to provide your own version of _golem_base.json if you don't want those items to drop.