MicroLLM Lab – Try 7 tiny LLM's in the browser

Run Q4 small language models entirely in the browser with WebGPU. Chat, benchmark, and compare PetitGPT, SmolLM2, and friends on-device.
280 points by logicallee 23 days ago stateofutopia.com 113 comments

Summary

Experiment with seven compact language models directly in your browser, using WebGPU for enhanced performance. Chat and benchmark models like PetitGPT and SmolLM2 to see how they stack up against each other.

Comments (113 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open