Flash-Moe: Running a 397B Parameter Model on a Mac with 48GB RAM

Running a big model on a small laptop. Contribute to danveloper/flash-moe development by creating an account on GitHub.
393 points by mft_ 213 days ago github.com 121 comments
Summary not yet generated for this article.

Comments (121 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open