Llama.cpp 30B runs with only 6GB of RAM now

1311 points by msoad 1301 days ago github.com 414 comments
Summary not yet generated for this article.

Comments (414 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open