Pool spare GPU capacity to run LLMs at larger scale
reference impl with llama.cpp compiled to distributed inference across machines, with real end to end demo - michaelneale/mesh-llm
Summary not yet generated for this article.
Comments (2 of ) ⌛