GitHub - welcome-to-the-sunny-side/misa77: Ridiculously fast decompression at good ratios. misa77 is 1.5-3x faster than LZ4 for decompression on x86 and ARM (with better ratios!).

Show HN: misa77 - a codec that decodes 2x faster than LZ4 (at better ratios)

Ridiculously fast decompression at good ratios. misa77 is 1.5-3x faster than LZ4 for decompression on x86 and ARM (with better ratios!). - welcome-to-the-sunny-side/misa77

164 points by nonadhocproblem 98 days ago github.com 49 comments

Summary not yet generated for this article.

Original Text

I've spent the last few months working on this codec.

It has the following characteristics:

  - SOTA decompression throughput in its ratio class
  - Decent ratios (comparable to LZ4 at high effort levels)
  - Slow compression

Most of the gains can be attributed to reducing branches and making decompression very friendly to out-of-order cores, by using a smart format.

Results on the tarred Silesia corpus on Intel x86-64 follow:

  codec       decode      ratio    encode
  misa77 -0   5219 MB/s   42.64%   54.5 MB/s
  misa77 -1   4274 MB/s   39.65%   51.2 MB/s
  lz4         2505 MB/s   47.59%   371 MB/s
  lz4hc -12   2531 MB/s   36.45%   7.31 MB/s

Comments (49 of ) ⌛

Loading more comments... ⌛

Scroll down to load more comments

No comments available.