Hi

I have 500+ GB worth of chunks, but I actually would like to keep them. I have my reasons.
However, they still take up too much disk space, so I started experimenting with compression.

Using zstd as an example, with it's default settings, I was able to achieve a compression ratio of 14.8% for the end dimension. Other dimensions have worse ratios, but lots of gigabytes were still saved.

Using one of the servers I play on as an example:

With a custom zstd dictionary, I'm sure these compression rations can be further improved. But this was just a quick test. zstd compression was developed for real-time usecases like this, and it would be awesome if it was integrated into bobby.

Or at least some form of fast compression with similar ratios would be nice.

Other mods I use that also store some world data, also use some form of compression, notably Baritone and Xaero. Baritone uses gzip and xaero uses zip with "deflate".