The towers that spawn for me are just full of structure voids. These things are in front of chests, ladders, and even the front door. I do not think if it's on my side, but if it is I would like to know how to fix this issue. Thanks

Fixed in 1.1.1. Structure Voids are bad and I will never touch them again.
Thanks for the report!