Patchouli comes with a config option named "Inventory Button Book", that allows to add a patchouli book of choice to the players inventory to replace the recipe book icon. Enabling the "remove recipe book" option in universal tweaks, this removes the patchouli book as well.
Could you add similar functionality to universal tweaks? Displaying a patchouli book inside the players inventory while still having the recipe book removed.