I found a big sphere of Spectrite Bone Blocks but can't mine any of them. Why can't I?

I'm using a Pickaxe from Silent's Gems too if that might be the issue.