Show HN: Reame – a CPU inference server that gets faster as it runs

Reame — CPU-first LLM inference server on llama.cpp: disk KV cache, self-regulating speculation, generation archive, interleaved multi-user, the Conclave. Your hardware, your realm. - swellweb/reame
56 points by targetbridge 102 days ago github.com 18 comments
Summary not yet generated for this article.

Comments (18 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open