Edit: disabling "experimental_sign_text_buffering" seems to fix it. Might want to make false the default.

with vs without mod

This is caused by the sign buffering optimization. This optimization is currently experimental and only works with English characters. It is not enabled by default. That's probably something the modpack you use did