3. Integer Quantization: Deep Dive (hello-fri-end.github.io)

A lot has happened in transformer quantization over the past few years, from barely being able to quantize a 7B model in INT8 without...

Article Details

Browse by Date

Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open