Run any LLM on your Mac Locally — faster than LM Studio or Ollama

Show HN: Mlx-serve – LLM inference server for Apple Silicon, written in Zig

Native Zig inference server for Apple Silicon. MLX + GGUF. OpenAI- and Anthropic-compatible APIs. No Python. Drop-in alternative to LM Studio and Ollama on macOS.
2 points by ddalcu 111 days ago mlxserve.com 0 comments
Summary not yet generated for this article.

Comments (0 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open