Had a person on my server put a child's doll in his house, and it totally crashed the game so bad that if you even looked at the doll, your whole game would crash out.
After fixing that we realized the drops from villagers (possibly just family?) crash the game out too.

Here's the crash report.
https://pastebin.com/4KdKxWKa