Mesh LLM: distributed AI computing on iroh

Mesh LLM: distributed AI computing on iroh

How Mesh LLM pools existing GPU resources across machines into a single OpenAI-compatible API, built on iroh.
343 points by tionis 102 days ago www.iroh.computer 92 comments
Summary not yet generated for this article.

Comments (92 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open