every time I enter the world there is gunpowder and nether wart in the brewing stand just because there are connectors nearby

Use the inventory configurator (On 1.21+) and click the Include in Inventory Connectors 5th button on the left.