If the server sends invalid packets, it makes the replay unplayable. Usually this is due to missing mods but on some servers it happens with just ReplayMod alone. For those cases I suggest skipping invalid packets because there shouldn't really be too many of them on vanilla server anyway.

If it happens with just ReplayMod alone, then that's a bug that should be fixed. Suppressing those errors would just make it harder to debug those issue and result in various other issue that aren't even real issues to begin with.
If it happens because you're missing mods, then the chance of the replay working if we just skip parts of it are minuscule.