When the server is stopped any changes I've made to the .yml are deleted. What am I doing wrong?

You need to either edit the yml files before starting the server or use "/si reload" in game to reload them.