I have chest full of enchanted book in vanilla and I would like to search for one specific enchant and currently the mod will just select all of the enchanted books.

I just use the item filter of JEI. You can try if JEI can filter enchantments per tooltip search ( # ). But I can't add support for enchantments without writing my own search system.