Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware

Pick hardware and a model, and feel the real speed of a local LLM before you buy. Simulates tokens/sec and time-to-first-token from verified benchmarks for GPUs, Macs, and more.
329 points by albinstman 4 days ago llmspeed.dev 86 comments

Summary

Llmspeed allows users to test the performance of local language models by simulating speed metrics based on various hardware options. This tool helps potential buyers evaluate how well different setups will handle LLM tasks before making a purchase.

Comments (86 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open