GitHub - omgitsbase/llmash: ollama like local llm interface, optimized to run most models 2-4x faster, even faster than vllm most of the time (tables below)

Show HN: Ollama stand in replacement, 2-4x faster, not just basic optimizations

ollama like local llm interface, optimized to run most models 2-4x faster, even faster than vllm most of the time (tables below) - omgitsbase/llmash
3 points by wowitsbase 44 days ago github.com 0 comments
Summary not yet generated for this article.

Comments (0 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open