It would be very nice as some of the models are very odd looking and jarring

Solution:
A simple toggle rendering button or config option that is featured in other mods

You can already toggle visibility by right-clicking the item in your inventory. I'll probably look into improving this a bit in the future though, since right now it's not really clear this exists. Best case scenario Trinkets just adds a button for this.