Show HN: Mantis, A self-hosted LLM gateway
An open-source, self-hosted LLM gateway providing a single interface for interacting with multiple LLMs - Mantis
Summary not yet generated for this article.
Original Text
Hey HNers - Riz here.
I got together with a few guys and we built an LLM gateway.
It's designed for small teams working on early-stage products, and can be deployed to AWS using a single command (i.e. `mantis deploy`).
It's self-hosted, and is designed to belong to you.
Comments (0 of ) ⌛