You can build this

and then do this and it will still work (yes it is empty inside)

You should allow building this with obsidian too.

This is actually intended!
The reasoning is so that you could expand upon it. For example you could use a trapdoor as a hatch for the smoke.