so i guess i accidently adopted a someone's baby while moving it and it died later and the grave stone broke but now he's just stuck there in my family tree and it's annoying me

Family is family, you would need to open the familyTree data using an nbt editor if you really want to.