For balance reasons, a config to disable functionality while in the inventory would be really useful. Especially with the Artifacts/similar other mods installed, it could be a tough decision for players to make on what to put in their belt slot.

Uhm, what version are you playing with? Because Tool Belt hasn't been able to be used from the inventory for a long time...