GitHub - aurorallm/aurora: The Fastest enterprise AI gateway — route LLM traffic across OpenAI, Anthropic, Gemini, Groq & 30+ providers via a single API. Self-hosted, no vendor lock-in. ( 55x faster than litellm )

Show HN: Aurora – AI Gateway built in Go

The Fastest enterprise AI gateway — route LLM traffic across OpenAI, Anthropic, Gemini, Groq & 30+ providers via a single API. Self-hosted, no vendor lock-in. ( 55x faster than litellm ) - auro...

7 points by gurveer51 81 days ago github.com 1 comments

Summary not yet generated for this article.

Original Text

Every Ai project needs the same infra - API keys, providers SDKs, retry logic, cost tracking. it should be infra layer. Aurora is a Go gateway that handles that layer, ~15MB binary, no dependencies. It proxies requests to OpenaAI, Anthropic, Gemini etc, and can convert between formats - use the OpenAi SDK and Aurora translates to Anthropic's wire format automatically. No format conversion code in backend.

It helps: - track costs per customer/team - switch models and providers without changing code - debug requests and responses flows more easily - reduce costs with exact and semantic caching

How its different than other gateways: - auto-discovers providers models - provider pools with automatic failover switch - built in guardials, audit logging with export, analytics, admin dashboard - model aliases, regional deployment to reduce latency. - can be used in infra directly and admin endpoints let control everything, creating managed api keys on user onboard and more.

The oss version (Apache 2.0) includes everyhting. Enterprise adds SSO, RBAC, and tenant isolation.

Original Text

Comments (1 of ) ⌛