I've tried breaking the cave crystals with several pickaxes, including silktouch, and even breaking the stone under the crystal and not one was recovered.

Have you tried right clicking on them?

o_O I would have never thought to try that... I think it needs to go in the mod description.
Thanks.