Homebench – Benchmark local LLMs for speed, memory, and quality

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM. - david-g-3654/homebench
51 points by davai-g 79 days ago github.com 5 comments

Summary

Homebench allows users to efficiently benchmark local large language models (LLMs) across speed, memory usage, and quality with a single command. It features a TUI leaderboard for popular frameworks like Ollama and llama.cpp, making it a handy tool for developers looking to optimize their models.

Comments (5 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open