LLM Router
Language English
Only the languages this router has a message catalog for are offered. A message that language has not translated is shown in English.

LLM Router

One OpenAI-compatible endpoint in front of all your inference engines.

LLM Router is a fast, self-hosted reverse proxy that sits in front of every OpenAI-compatible engine you run — LM Studio, oMLX, vLLM, llama.cpp, Strata, and anything else — and exposes a single OpenAI-compatible API. It is not an inference engine or a cluster: it is the smart layer between your apps and your hardware, handling routing, priorities, load balancing, private connectivity, monitoring, and administration. It is built for the messy reality of self-hosted inference: your PCs shut down, engines unload models when idle, one box is fast but small and another is slow but huge. The router prefers warm models, fails over before the first byte, and never assumes a static datacenter behind it.

What it does

Inside the router

Screenshots coming soon — the boxes below describe what each image will show.