I have improved mobs so that might be the issue but when guard villagers see me they randomly attack me for no reason and chase me until I kill them

Try removing improved mobs and if you have it the ai improvements mod

closing due to inactivity