In the configuration it gives you an option to disable the scoreboard in different worlds, I go to the world its not disabled in it works, then when I go to a world its supposed to be disabled its still there (and still working ).

Should be fixed now