I noticed that in earlier versions in MCA that you couldn't remove your baby out of your inventory other then putting it into a villager's inventory.