setting passive endermen to false in thevanillaexperience.toml doesn't work, you have to disable the configs in the mod config file inside the TVE folder.