attempting to mine dirt/gravel/sand from the hallow (the deceased ones) is the same as digging with your hand, even if you have a shovel.
im using an adamantine shovel, but it shouldnt matter if its not a vanilla one.