While sparkforge is on the server it will not properly stop. It must be manually killed to stop it as intended.
MC 1.16.3
Forge 34.1.42

PS: Is this backwards compatible? Can I use the 1.16.4 versions on 1.16.3?

Should be fixed in the latest version - thanks for reporting :)