Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook - drumih/turbo-fieldfare
906 points by gitpusher42 84 days ago github.com 341 comments

Summary

A developer has created TurboFieldfare, an inference engine that enables the running of the 4-bit Gemma 4 26B model on M-series Macs with only 2 GB of RAM. This innovation allows for powerful on-device AI experiences, even with models that typically require much more memory.

Comments (341 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open