I know, this is later after, but I think silk touch should be the priority for good reason. If you silk touch something, you can still use a fortune on it later if you choose to. This would make it better for when you accidentally mine something that breaks if you don't use silk touch, such as an ender chest or glass.

Should the Tool Switch just always prioritize Silk Touch tools?

I think there was another report that the tool switch should also prefer the hotbar, so that's one way of selecting between silk touch or not (or fortune). But assuming there is a silk touch and non-silk touch tool in the hotbar, should it prefer the silk touch or use the one that is further to the left?

I think it would be best to have a setting that can be set to prioritise silk touch, non silk touch, or no priority at all. Could be called toolSwitchMode or something similar

If possible Id like to push Gregors Idea, but just prefering silk would be fine for me too, as thats the safer options and silked ores also take less inventory space when mining, can be fortune breaked later without ToolSwitch on or without the silk pick in the inventory. Guess for now I gonna put my fortune pick in a shulker box till I use it.