There's a bug with where Planter ants will attempt to till already-planted crops, and will only focus on it until it is sheared or harvested.

I can't seem to replicate this bug sorry.

Maybe it should target the closest dirt block avaliable, rather than persistence that causes problems.