Asymmetric Quantization: Near-Lossless Retrieval with 97% Storage Reduction

Late interaction makes retrieval more precise but turns every document into many vectors. Asymmetric quantization keeps query vectors precise and stores document vectors as binary signs, cutting corpus storage 32x while holding 89.65 vs 90.26 NDCG@10.
94 points by breadislove 114 days ago www.mixedbread.com 32 comments
Summary not yet generated for this article.

Comments (32 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open