Ask HN: Thoughts on AMD Ryzen AI MAX+ 395 for Local AI?

3 points by mempirate 86 days ago 4 comments
Summary not yet generated for this article.

Original Text

Wondering if anyone has played around with the Strix Halo based systems with 128GB of unified memory for local AI, and what their experience has been so far in running different models: - Practical limit on number of parameters x quantization - What you've been using it for - Which models and inference engines combine well

Comments (4 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open