Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

Contribute to leonickson1/Swiftlet development by creating an account on GitHub.
311 points by leonickson 79 days ago github.com 142 comments
Summary not yet generated for this article.

Comments (142 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open