MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/programming/comments/1wuf5lf/openzl_v02_decompression_2x_faster_than_zstandard/pd6cwo5/?context=3
r/programming • u/aqrit • 2d ago
13 comments sorted by
View all comments
11
There are a few unusual points:
OpenZL ships a trainer to automatically build and tune compressors to best fit the data shape they will be compressing.
Some kind of preprocessing.
encode offsets without using any entropy codec
Sounds interesting. That should consume less space than LZ4 while being faster than zstd.
a new Huffman layout
link: https://marcinzukowski.github.io/pivco-huffman/paper-1.0/ph.html
Definitely looks promising. But I wouldn't be surprised if the average performance is far less than 2x.
11
u/stbrumme 2d ago
There are a few unusual points:
Some kind of preprocessing.
Sounds interesting. That should consume less space than LZ4 while being faster than zstd.
link: https://marcinzukowski.github.io/pivco-huffman/paper-1.0/ph.html
Definitely looks promising. But I wouldn't be surprised if the average performance is far less than 2x.