This only happens if you get kicked in singleplayer, not multiplayer (as shown in video)

I'm using chat spam to get kicked easily with cheats disabled, youll have to get kicked some other way if cheats if enabled

YouTube Video (Using YouTube because the file is too big)

Thanks for reporting this issue, it'll be fixed in the next version