by felixhandte on 11/19/21, 8:12 PM
As someone on the Zstd team, I'm always happy to see it on HN! I'm curious though what motivates the submission?
by thriftwy on 11/19/21, 9:00 PM
Zstandard has very cool dictionary training feature, which allows to keep a separate dictionary and have a 50% ratio compression on very small (~100b) but repetitive data such as database records.
by vlovich123 on 11/19/21, 8:28 PM
Is there a reason zstd isn’t popular for HTTP and only brotli and gzip see adoption?
by jeffbee on 11/19/21, 8:19 PM
Does this mean the Zstd magic number is now cast in stone?
by kzrdude on 11/19/21, 9:26 PM
by ggm on 11/19/21, 9:37 PM
It's said to be a good fit for ZFS. I tend to lz4 because its baked into the older systems I use, but it may be at a point where my default should be zstd.
bz2/gz still predominates for compressed objects in filestore from what I can see.
by buryat on 11/19/21, 8:53 PM
i forgive facebook all their abuses just because they gave us zstd
by m0zg on 11/19/21, 8:50 PM
Zstd is an amazing bit of work and all I ever use for data compression nowadays (or LZ4 when speed is even more critical). Several times the compression/decompression speed of gzip, approximately the same compression ratio with default settings.
It's also supported by tar in recent Linux distros, if zstd is installed, so "tar acf blah.tar.zst *" works fine, and "tar xf blah.tar.zst" works automatically as well. Give it a try, folks, and retire gzip shortly afterwards.
by erichocean on 11/19/21, 9:51 PM
Does Zstandard still have the junk Facebook license attached to it?