When mining with the hammer, you only get XP from ores you directly touched with the hammer, not the outer mined blocks. This is easily reproducible by placing stone in the middle of a 3x3 area and redstone ore around it, then mining the stone. You don't get any XP, despite the redstone ore getting mined.