The sorting buttons don't work with Arcane Archives' Radiant Chests, because the default code does not expect there to be more than 64 items in a single slot.

This is what the dev of Arcane Archives had to say about the situation:

There are functions to determine the maximum limit of a slot -- which may be more than can be removed from a slot in a single action. I realise that this is me simply passing the buck back onto them, but reintroducing the behaviour where the entire slot's contents could be removed, allowing you to pick up full stacks of 256, causes a number of interface issues and a lot of confusion and frankly isn't really an option for me.

And outside of this solution, there's not really anything that I can do (at least that I'm aware) to better facilitate things.

I would like to personally reach out to the Inventory Tweaks & Quark teams to discuss it, but my motivation to work on this mod recently has faltered slightly, and I'm not sure what else I can do to make it a possibility.

I really hope that you can work with Noobanidus to resolve this issue, as the sorting buttons are a godsend and Arcane Archives is a really neat mod that is also designed to make storage and organization easier.