Orthrus-Qwen3: up to 7.8×tokens/forward on Qwen3, identical output distribution

Fast, lossless LLM inference via dual-view diffusion decoding. - chiennv2000/orthrus
240 points by FranckDernoncou 159 days ago github.com 43 comments
Summary not yet generated for this article.

Comments (43 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open