I unintentionally click on blocks like dirt while counting because I habitually left-click with an empty hand. Having a config option to make the mod switch tools only when holding a different tool would be really nice and more intuitive imo.

I'm so sorry. This was done the day after you opened this issue, I just forgot to publish it.