Ask HN: What does your local LLM setup looks like?

6 points by the-mitr 129 days ago 7 comments
Summary not yet generated for this article.

Original Text

What models and hardware you are using? For what purpose? What were the challenges? Any tricks that helped you in doing this?

This might help new users like me setup theirs.

Comments (7 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open