My local model setup on an M4 Pro Mac Mini

I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM.
322 points by raybb 50 days ago lws.io 192 comments

Summary

Learn how to set up a local large language model server on an M4 Pro Mac Mini, complete with tips for optimizing performance with its 48 GB of RAM.

Comments (192 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open