Show HN: Made a Free LLM Router
FlexInference is a deadline-aware LLM router across OpenAI, Gemini, and Anthropic. It is OpenAI-compatible, so you keep the OpenAI SDK and add start_within.
Summary not yet generated for this article.
Original Text
Hey everyone! Been working on a router that works with OpenAI, Anthropic, and Google (Gemini not Vertex), and just launched it for free.
Let me know what you think.
Comments (1 of ) ⌛