If a structure in a village is found to have air/grass plants underneath it, replace with any ground material, so you don't have floating houses.

Too hard to fix because at runtime the structures are just random blocks in the world.

Ah it's not like there's a flag left in the world saying "This is a structure"? I wasn't sure because they have achievements based on being inside certain structures so thought it was detecting them somehow.