If there is some way to add a blacklist for the no block breaking rule or just add it as a block you can break, that would be appreciated.

You can use the ignored_stone_blocks tag to make this work.