For example, maybe when water flows quickly beside or over top of sand, there's a 1/1000 chance that it moves the sand one block in the direction the sand is flowing.

Maybe different materials would have different erosion probabilities. Sand and gravel for example might be 1/1000, soil might be 1/10000, stone might be 1/100000