GitHub - amos-labs/expertcache: Page-aware Metal inference research for oversized sparse mixture-of-experts models on Apple Silicon

Show HN: ExpertCache – Run the Full GPT-OSS 120B (63GB) on a 16GB M1 Pro

Page-aware Metal inference research for oversized sparse mixture-of-experts models on Apple Silicon - amos-labs/expertcache
4 points by rick_barkley 75 days ago github.com 0 comments
Summary not yet generated for this article.

Comments (0 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open