Describe the bug
At the moment im on 1.20.1 and working on the Noble quest all i have to do is raise population. Anywho everytime i leave the village to get wood, mine or anything thats outside the limits of the town i have to start all over minus the hearts except everytime i have this issue i have to invite a new villager to the village just to get the hearts back in the blueprint item.

the other issue im having is every time i try to asign a villager to a job it says cant find the jobsite. I destroy it place it and same thing its about the 5th time doing that works

Steps to Reproduce
Not sure i have 8 big house and 1 of each building type minus prison, music store and blacksmith.

Minecraft Information (please complete all questions entirely):

• Minecraft Version: [e.g. 1.20.1]
• Launcher: [Curseforge]

Modpack Information
Complete this section if you are using a modpack.

• Modpack Name: [all the mods 9] plus minecraft comes alive reborn
• Modpack Version: [e.g 0.0.45]