If an item can stack in containers but not the inventory, the F key can be used to move the stack into your inventory regardless.
If totems stack to 16 in containers, but only to 1 in the inventory, you can press F while hovering your cursor over a totem stack to move all 16 into your offhand.