GetNotes Tools
diegosouzapw/OmniRoute
Tool นี้คืออะไร
OmniRoute คือ AI Gateway ฟรีที่ช่วยให้นักพัฒนาเข้าถึงผู้ให้บริการ AI กว่า 271 ราย รวมถึง 90+ แพลตฟอร์มฟรี ผ่านเอนด์พอยต์เดียว ช่วยประหยัดค่าใช้จ่ายด้วยการรวม Free Tier และป้องกันการติดขีดจำกัดด้วยการสลับใช้งานอัตโนมัติ
ข้อมูลโปรเจกต์
ดาว
21.9K
Forks
3K
License
MIT
อัปเดต GitHub ล่าสุด
21 ก.ค. 2569
เพิ่มใน GetNotes
21 ก.ค. 2569
Repository
diegosouzapw/OmniRoute
รูปแบบ
เหมาะกับงาน
เหมาะกับอาชีพ
Ecosystem
TypeScript
แปลและเรียบเรียงโดย AI
เนื้อหาฉบับภาษาไทย
ใช้อ่านเพื่อทำความเข้าใจเบื้องต้น โปรดตรวจสอบรายละเอียดสำคัญกับเอกสารต้นฉบับด้านล่าง
🚀 OmniRoute — AI Gateway ฟรี
💰 ~1.4 พันล้านโทเค็นฟรี / เดือน
การรวม Free Tier ด้วยตนเองเป็นเรื่องที่ยุ่งยาก — ต้องจัดการ SDK หลายสิบตัว, อัตราการจำกัดหลายสิบแบบ และไม่รู้ว่าคุณมีเท่าไหร่จริง ๆ OmniRoute รวบรวม Free Tier ที่ มีเอกสารกำกับ ของ 39 กลุ่มผู้ให้บริการ / 460+ โมเดล ให้เป็นตัวเลขที่ซื่อสัตย์เพียงหนึ่งเดียว และแสดงผลแบบเรียลไทม์บนแดชบอร์ด (/dashboard/free-tiers)
สรุปภาพเคลื่อนไหวของหน้า /dashboard/free-tiers แบบเรียลไทม์ ระเบียบวิธีฉบับเต็ม (การลบรายการซ้ำของกลุ่ม, ระดับเครดิต, ข้อกำหนดของผู้ให้บริการ): docs/reference/FREE_TIERS.md
ตัวเลขเหล่านี้จะถูกตรวจสอบซ้ำทุกสองสัปดาห์เทียบกับแค็ตตาล็อกปัจจุบัน และ มีการเปลี่ยนแปลงได้ทั้งสองทาง — ผู้ให้บริการยกเลิก Free Tier ตัวเลขก็จะลดลง; มีผู้ให้บริการใหม่เข้ามา ตัวเลขก็จะเพิ่มขึ้น เราเผยแพร่สิ่งที่แค็ตตาล็อกคำนวณได้จริง ไม่ใช่กรณีที่ดีที่สุดที่ปัดเศษขึ้นมา CI gate (check:docs-counts) จะทำให้บิลด์ล้มเหลวหากหัวข้อนี้แตกต่างจากโค้ด
⭐ กด Star ให้กับ repo หาก OMNIROUTE ช่วยคุณประหยัดเงินและทำให้การทำงานของคุณง่ายขึ้น
💬 เข้าร่วมชุมชน
คำถาม, เคล็ดลับผู้ให้บริการ, แผนงาน & การสนับสนุน → Discord · Telegram · WhatsApp 🌍 ทั่วโลก / 🇧🇷 บราซิล
🧩 พร้อมใช้งาน
🚀 เริ่มต้นใช้งานอย่างรวดเร็ว • 🎯 คอมโบ • 🌐 ผู้ให้บริการ • 🔌 CLI & MCP • 🗜️ การบีบอัด • 🌍 เว็บไซต์
💥 คำมั่นสัญญา • 🤔 ทำไมต้อง OmniRoute • 🏆 อะไรที่ทำให้ OmniRoute แตกต่าง • 🤖 CLI ที่เข้ากันได้ • 🖥️ สามารถรันได้ที่ไหน • 🔒 ส่วนตัว • 🎬 การทำงานของ OmniRoute • 📸 ภาพหน้าจอแดชบอร์ด • 📧 การสนับสนุน
💥 คำมั่นสัญญา
🤔 ทำไมต้อง OmniRoute?
🎯 Combos — คุณสมบัติเด่น
combo คือสายโซ่ของโมเดลที่ OmniRoute กำหนดเส้นทางให้ โดยอัตโนมัติ เมื่อโควต้าหมด ผู้ให้บริการล้มเหลว หรือค่าใช้จ่ายพุ่งสูงขึ้น combo จะเลื่อนไปยังโมเดลถัดไปอย่างเงียบๆ นี่คือสิ่งที่ทำให้ OmniRoute ไม่สามารถถูกทำลายได้ 🛡️
⚡ Zero-config — เพียงแค่ใช้ auto
ไม่ต้องสร้าง combo ใดๆ เพียงตั้งค่าโมเดลของคุณเป็น auto (หรือรูปแบบอื่น) แล้ว OmniRoute จะสร้าง combo เสมือนจากผู้ให้บริการที่คุณเชื่อมต่อ โดยมีการให้คะแนนแบบเรียลไทม์:
| Model ID | สิ่งที่ปรับให้เหมาะสมที่สุด
| ตัวควบคุม | สิ่งที่ควบคุม |
|---|---|
| ⚖️ น้ำหนักการจัดสรร | สัดส่วนของแต่ละคีย์ในพูล — เช่น 50 / 30 / 20 |
| 📐 มิติ | ติดตาม % · คำขอ · โทเค็น · $, ต่อช่วงเวลา 5 ชั่วโมง / 7 วัน / ต่อโมเดล |
| 🚦 นโยบาย | hard (บล็อกเมื่อเกินส่วนแบ่ง) · soft (ลดลำดับความสำคัญ) · burst (ใช้ส่วนเกินที่ไม่ได้ใช้งาน) |
| 🧱 ขีดจำกัด | เพดานสูงสุดต่อคีย์ โดยไม่ขึ้นกับโหมด |
บังคับใช้ใน hot path ก่อน ที่คำขอจะออกจาก OmniRoute ด้วยขีดจำกัดต่อ (คีย์, โมเดล) + การคงสถานะเซสชันเพื่อความสมบูรณ์ของ prompt-cache (ตอนนี้มีตัวเลือกปิดใช้งานต่อ
🤖 CLI และ Coding Agent ที่เข้ากันได้
การตั้งค่าเดียว — http://localhost:20128/v1 — และ ทุก AI IDE หรือ CLI จะทำงานบนโมเดลฟรีและราคาประหยัด
เอกสารโปรเจกต์
อ่านเอกสารต้นฉบับ
README วิธีติดตั้ง วิธีใช้งาน และข้อกำหนดจาก repository ต้นฉบับ

🚀 OmniRoute — The Free AI Gateway
💰 ~1.47B Free Tokens / Month
Stacking free tiers by hand is painful — dozens of SDKs, dozens of rate limits, and no idea how much you actually have. OmniRoute catalogs 444 free-tier entries across 34 recurring pool keys and computes the token headline from the 16 pools with a published positive monthly budget plus five per-model Groq caps, deduplicated by shared pool. Quotas that only open after a regional identity check (today: ModelScope) are shown apart, +~6M behind regional identity verification, and never summed into the headline. The result stays visible on the dashboard (/dashboard/free-tiers).
Animated summary of the live /dashboard/free-tiers page. Full methodology (pool dedupe, credit tiers, provider terms): docs/reference/FREE_TIERS.md.
These figures are re-audited every two weeks against the live catalog and move both ways — a provider ends a free tier and the number drops; a new one lands and it climbs. We publish what the catalog actually computes, never a rounded-up best case.
⭐ Star the repo if OMNIROUTE helped you save money and make your work easier.
💬 Join the community
👋 Follow the maintainer — get new providers, releases & tips first:
Questions, provider tips, roadmap & support → Discord · Telegram · WhatsApp 🌍 Global / 🇧🇷 Brasil / Portal
📈 The Gateway Keeps Growing
| v3.8.49 | v3.8.50 | v3.8.51+ | |
|---|---|---|---|
| 🌐 Providers | 290 | 352 | more queued |
| 🧠 Unique chat model IDs | 1185 | 1312 | — |
| 🖼️ Modality Bridge | — | 🆕 vision + audio + video | — |
| 📡 Radar free catalog | — | 🆕 opt-in | — |
| ⚖️ Quota-aware scheduling | — | 🆕 Quota-Share | — |
| 📊 Quota telemetry | — | 🆕 live | — |
→ Roadmap — riding the rail to v3.9.0 LTS
🧩 Available
🆓 Works the second you install it — no keys, no config
# Fresh install, zero credentials — `auto` already works:
curl http://localhost:20128/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"model":"auto","messages":[{"role":"user","content":"Hello!"}]}'Prefer a specific free backend? Call oc/… (OpenCode Free) directly. Then graduate to auto and let OmniRoute pick.
📦 Copy-paste quickstart scripts for Python, Node.js, PHP, and cURL → examples/quickstart/
💥 The Promise
🤔 Why OmniRoute?
🤝 Supported by our Open Source Friends

Want to join as an Open Source Friend? These are the companies that back open source and help keep OmniRoute moving — and we say publicly where every token they give us goes. Reach out: diegosouza.pw@outlook.com
Links tagged aff=omniroute are partner links. They fund the project at no extra cost to you.
This section is for referral/coupon codes only. Sponsored partnerships live in 🤝 Supported by our Open Source Friends above. OmniRoute has no sponsorship or partnership with the providers listed here — these are public coupons anyone can use.
Know another provider with a generous free signup coupon that benefits OmniRoute users? Open an issue and we'll add it here.
🎯 Combos — The Flagship
A combo is a chain of models OmniRoute routes across automatically. If quota runs out, a provider fails, or costs spike, the combo can move to the next eligible healthy model. 🛡️
⚡ Zero-config — just use auto
No combo to create. Set your model to auto (or a variant) and OmniRoute builds a virtual combo from your connected providers, scored live:
🔀 Or build your own — 19 routing strategies
All 19 strategies — mix & match per combo step:
The Auto-Combo engine scores every candidate on 16 factors (health, quota, cost, latency, task fit, quality, session availability…) — see docs/routing/AUTO-COMBO.md.
🧱 Resilience is built in (3 independent layers)
📖 Auto-Combo Engine · Resilience Guide
🏆 What Sets OmniRoute Apart
📊 Full methodology & per-feature detail vs 9router, OpenRouter, CLIProxyAPI & LiteLLM → docs/comparison/OMNIROUTE_VS_ALTERNATIVES.md
💚 Support OmniRoute
OmniRoute is MIT-licensed and maintained in the open. If it saves you time or money, here's how to keep it independent — pick whatever fits you. Sponsorship never affects routing priority; it buys visibility, not ranking.
🇧🇷 PIX — instant, no fees (Brazil)

Key (random): 5d865059-bc44-483a-962d-43ceb80126eb
Pix copia-e-cola:
00020101021126580014br.gov.bcb.pix01365d865059-bc44-483a-962d-43ceb80126eb5204000053039865802BR5922OMNIROUTE CONTRIBUICAO6006BRASIL62070503***630475DD⚠️ Send each coin only on the network shown — sending on the wrong network can lose the funds.
🐛 Found a bug or have feedback? Open a Discussion.
📡 OmniRoute Radar
The main free-tier headline remains ~1.47B tokens/month from the documented, pool-deduplicated catalog above. Temporary provider signup credits can separately lift the first month to ~2.10B. Radar is an optional, signed catalog overlay for people who want fresher free-model availability between OmniRoute releases; the community catalog and every existing free feature remain free.
Supporters can receive the live catalog and additional provider opportunities. Its separate, mutable ceiling is approximately 3B tokens/month at most, depending on provider availability. That ceiling is not a guarantee: providers can change quotas, eligibility, models, or regions at any time.
Radar is opt-in and GET-only. The OmniRoute client does not upload prompts, traffic, provider configuration, usage telemetry, or local announcement-dismiss state. Learn about eligibility and the current catalog at radar.omniroute.online/planos.
✨ What's New
Recent highlights from v3.8.20 → v3.8.50. Full history in CHANGELOG.md.
- 🎛️ OmniConductor — inbound A2A delegation to your agent fleet, Conductor skills on the Agent Card, and a dashboard panel with Faro push-to-talk voice chat. → A2A Server
- 🛂 Adaptive admission & overload protection — heavyweight chat requests queue instead of 503ing, with atomic RPM rolling leases per connection. → Resilience Guide
- 🗂️ Canonical
/v1/modelsordering — one contiguous provider-grouped block per provider (combos pinned first), stable across every catalog source. → API Reference - 🗜️ Compression hardening — default-on inflation guard, Caveman packs for DE / FR / JA + Chinese (wényán), RTK filters for Gradle & .NET. → Compression
- 💸 Honest flat-rate cost — subscription / coding-plan providers read $0 in cost analytics; budget, quota & routing keep estimating. → API Reference
- ⚖️ Quota-Share routing — split a shared account's quota fairly across pooled keys, work-conserving so idle slices are lent out. → Resilience Guide
- 🤖 One-command CLI/agent setup — 13 registered
setup-*commands;omniroute runlaunches 7 CLIs (Claude Code, Codex, Aider, Goose, OpenCode, Qwen Code, Gemini CLI);omniroute configuresupports 10 targets with an interactive provider+model picker and per-context favorites. → CLI Integrations - 🛰️ Remote mode — drive a remote OmniRoute with scoped tokens (
connect/contexts/tokens) + anantigravityOAuth helper for VPS installs. → Remote Mode - 🧭 Smarter auto-routing —
auto/<category>:<tier>combos, Fusion (model panel + judge), task-aware routing, per-request model / mode / USD-budget overrides. → Auto-Combo - 🗜️ Pluggable compression — 12 composable engines + Compression Studios: LLMLingua-2, two-tier Ultra, omniglyph, per-step fidelity gate, GCF v3.2, drag-reorder editor. → Compression
- 🕵️ Transparent MITM decrypt (TPROXY) — capture CLIs that ignore proxy env vars, with a per-SNI CA + trust-store installer. → MITM/TPROXY
- 💸 Cost telemetry everywhere —
X-OmniRoute-*cost/usage headers on every endpoint, cache-HIT savings header, per-key USD spend quotas. → API Reference - 🧠 Memory you control — off by default, opt-in int8 vector quantization + typed decay, per-request
x-omniroute-no-memory. → Memory - 🛡️ Security — prompt-injection guard on every LLM route (red-team suite), opt-in credential-masking guardrail (redacts leaked API keys/secrets in both directions), free DuckDuckGo last-resort web search, and an optional OIDC login gate for the dashboard (password login always stays available). → Guardrails
- 🖼️ New endpoints —
/v1/ocr(Mistral OCR) and/v1/audio/translations(Whisper-style) round out the media surface. → API Reference - 🎨 Image / video / audio generation — one API for media: xAI Grok Imagine & Novita AI video, ComfyUI, Magnific, Adobe Firefly, Segmind, and speech providers such as ElevenLabs. → API Reference
- 🌍 Deployment & ops — reverse-proxy
basePath, browser-language auto-detect, per-key device tracking, root-less MITM trust, zh-TW localization. → Environment - 🤝 More providers & agents — cloud agents (Codex Cloud, Cursor, Devin, Jules), Grok Build (xAI) with browser + OAuth login, Ollama first-class card, Claude Opus 5 & Sonnet 5, Kimi official partnership (Code/Web/Moonshot), Zed, Requesty, SenseNova, Yuanbao, Agnes AI… and a refreshed 352-provider catalog. → Providers
- 📡 Routing transparency — every response carries an
X-OmniRoute-Decisionheader naming the strategy/provider/latency that served it, a newcache-optimizedcombo strategy + Auto-CombocacheAffinityfactor route repeat requests back to the connection holding the cached prefix, and a read-only/v1/auto-combo/{channel}/candidatesendpoint exposes anauto/*channel's live candidate pool. → Auto-Combo - ⚡ Local performance & infra — one-click local Redis, Cloudflare Workers / Deno Deploy relay deployers, Bifrost & Mux as supervised embedded services. → Embedded Services
- 🧩 Also in the box — plugin framework + marketplace, Omni/Agent/GitHub skills frameworks, Obsidian vault integration (22 MCP tools), OpenAI-compatible Batch & Files APIs, semantic response cache, gamification with leaderboards, ACP agent discovery (15 built-in agents), scheduled log export to BigQuery,
auto/chaosfault injection, a Telegram bot bridge, an in-app version manager and LMArena-ELO free-provider rankings. → Docs
🤖 Compatible CLIs & Coding Agents
One config — http://localhost:20128/v1 — and every AI IDE or CLI runs on free & low-cost models.
📖 Per-tool setup for all 36 tools (26 CLI Code's + 10 CLI Agents) → docs/reference/CLI-TOOLS.md · 🧩 OpenCode plugin → @omniroute/opencode-provider
Launch any supported CLI through OmniRoute in one command — no config files written, credentials injected per process, Qwen/Gemini get a throwaway isolated home:
omniroute run claude --model openai/gpt-5.4 # Claude Code
omniroute run codex --model glm/glm-5.2 # OpenAI Codex CLI
omniroute run aider --model glm/glm-5.2 -- --message "reply OK"
omniroute run goose --model glm/glm-5.2
omniroute run opencode --model glm/glm-5.2 -- run "reply OK"
omniroute run qwen --model glm/glm-5.2 -- -p "reply OK"
omniroute run gemini --model glm/glm-5.2 -- --skip-trust -p "reply OK"
# Or pick provider+model interactively and write the tool's own config:
omniroute configure codex # also: claude opencode qwen aider goose gemini cline continue kiloEvery command honors the active remote context (omniroute connect <host>), --dry-run
previews the exact env/args without executing, and --api-key-env NAME keeps secrets out
of your shell history. → CLI Integrations
🌐 352 AI Providers — 152 Catalog-Marked Free
352 registered providers across the canonical chat, media, search, local, cloud-agent and system collections, including 152 carrying hasFree: true discovery metadata. The chat model registry covers 229 providers / 2,554 distinct provider-model pairs / 1,283 raw model IDs; the separate free-budget catalog has 444 per-model rows, 34 recurring pools and 52 recurring/keyless free-forever providers. These are different denominators by design; definitions and pool-deduped calculations live in the Provider Reference and Free Tiers.
🏢 Every major lab — through one endpoint
…and 330+ more — every icon resolves live from the dashboard's provider catalog. 📖 Provider Reference
🆓 Free Forever — $0, no card
📖 Full machine-readable catalog → docs/reference/PROVIDER_REFERENCE.md
🖥️ Where OmniRoute Runs — Anywhere
Same app, your machine, your rules. From a global npm install to your phone via Termux.
📖 Docker Guide · Desktop · Menu-bar tray · Termux · PWA · OpenCode
🧩 New: OmniRoute inside VS Code's native Copilot Chat
No new sidebar, no new chat UI — every model OmniRoute serves shows up right in the Copilot Chat model picker you already use. Since VS Code 1.122, provider models work without a GitHub sign-in or a Copilot subscription — agent mode, tool calling and vision, for free.
Install the OmniCopilot extension, point it
at your OmniRoute server (defaults to localhost:20128), then open Copilot Chat → model picker
→ Manage Models… → OmniRoute.
From inside the editor: open the Extensions view, search "OmniRoute", click Install — works the same way on both stores. Source, issues and the publishing runbook live at diegosouzapw/OmniCopilot.
📖 VS Code Copilot Chat guide — setup, what the picker shows, dashboard-in-a-tab, troubleshooting
🎩 New: OmniRouteTray — your gateway, living in the menu bar
omniroute serve is happiest when it's always on. OmniRouteTray
turns that into a set-and-forget menu-bar app for macOS: it starts the server, keeps it alive
across reboots, updates it in place, and puts your live token budget one click away — no
terminal window left open, no npm install -g omniroute to babysit.
Built with Tauri v2 (a Rust core the size of a rounding error), it ships
its own signed Node 24 runtime and manages an app-owned OmniRoute install, so it never fights your
global node/bun. It shares your existing ~/.omniroute/ config and database — so it's the
same OmniRoute you already run, just with a hat on. 🎩
brew install --cask zoispag/tap/omniroute-trayPrefer a download? Grab the latest .dmg from Releases. Source, issues and build docs live at zoispag/omniroute-tray. 💛 A community project by @zoispag — not an official OmniRoute release.
🔒 Private & Local-First
📖 Authorization · Guardrails · Compliance
🔌 Full CLI + A2A & MCP
Beyond the server, OmniRoute is a full command-line cockpit with 80+ commands, plus open agent protocols so an AI agent can drive it on its own.
⌨️ A real CLI (not just start)
omniroute # serve gateway + dashboard (port 20128)
omniroute chat # interactive TUI chat client (slash: /model /combo /skill /memory)
omniroute setup # guided first-run wizard
omniroute doctor # diagnose providers, ports, native deps🛰️ Remote mode — run the CLI here, OmniRoute on a VPS
OmniRoute on a server? Drive it from your laptop with the same CLI. Log in once with a scoped access token; every command then targets the remote.
omniroute connect 192.168.0.15 # password → scoped token, saved as a context
omniroute models list # ← runs against the REMOTE server
omniroute configure codex # ← picks a remote model, writes a local Codex profile
omniroute tokens create --name ci --scope read # mint narrower tokens for other machines
omniroute contexts use default # ← switch back to the local serverTokens are scoped read / write / admin; process-spawning routes stay loopback-only.
📖 Remote Mode
🤝 Connect an agent — and it controls OmniRoute itself
Expose OmniRoute over MCP, A2A, a REST API, webhooks or a remote CLI — any capable agent (or your own code) gets the keys to the whole gateway: routing, providers, combos, cache, compression, memory — autonomously. HTTP endpoints below are served under http://localhost:20128.
# Give Claude Code the full OmniRoute toolset over MCP:
claude mcp add-server omniroute --type http --url http://localhost:20128/api/mcp/stream📖 MCP Server · A2A Server · Agent Protocols
🗜️ Save 15–95% Tokens — Automatically
📖 How it works — pipeline, architecture & savings math
Default stacked combo runs RTK → Caveman. When both act on the same tool/context payload, savings compound:
combined = 1 − (1 − RTK) × (1 − Caveman_input)
average = 1 − (1 − 0.80) × (1 − 0.46) = 89.2%
range = 78.4 – 94.6%Code blocks, URLs, JSON and structured data are always protected by the preservation engine.
Why use many tokens when few tokens do the trick? Every request passes through OmniRoute's compression pipeline transparently — no client changes. It's now a stack of 12 composable engines that run in order and mix & match per routing combo — building on ideas from RTK, Caveman (⭐ 90K+), LLMLingua-2, and Troglodita (PT-BR).
🧱 The 12-engine stack
Engines run in pipeline order; each is independently toggleable and configurable per combo:
Code blocks, URLs and structured data are always preserved byte-perfect. One-click presets combine the engines:
Real example — Standard mode:
Before (69 tokens): "The reason your React component is re-rendering is likely because you're creating a new object reference on each render cycle. When you pass an inline object as a prop, React's shallow comparison sees it as a different object every time, which triggers a re-render. I would recommend using useMemo to memoize the object."
After (19 tokens): "New object ref each render. Inline object prop = new ref = re-render. Wrap in useMemo."
Same answer. 72% fewer tokens. Zero accuracy loss. ✅
PT-BR example — Troglodita mode:
Antes (42 tokens): "O problema é que o componente está re-renderizando porque uma nova referência de objeto está sendo criada em cada ciclo de renderização. Eu recomendaria usar useMemo."
Depois (12 tokens): "Re-render: ref nova cada ciclo (objeto inline recriado). Usar useMemo."
Mesma resposta. ~70% menos tokens. Precisão técnica intacta. ✅
🎚️ Beyond the engines — output styles, the adaptive dial & per-request control
The 12 engines above shrink what goes in. Three more layers shape how, when, and what comes out:
- 🪄 Output Styles (output-axis steering) — inject deterministic, cache-safe response-shaping instructions; combinable, each at
lite/full/ultraintensity. Adding a style is a one-line registry entry:- **Terse prose** — drop filler / articles / hedging; keep technical substance exact. - **Less code** — "lazy senior dev" YAGNI: smallest working change, no unrequested scaffolding. - **Ponytail (lazy senior dev)** — climb the YAGNI ladder, fix the root cause, smallest working diff. - **I have ADHD (action-first)** — next action leads, steps numbered, one concrete next step, no preamble. - **Terse CJK (文言)** — classical-Chinese ultra-terse style (locale-gated to `zh`). - 🎯 Adaptive context-budget (the dial) — instead of one on/off token threshold, escalate the cheapest, most-lossless engines only as far as needed to fit the model's context window. Policy:
reserve-output(default, model-aware) ·percentage·absolute. Mode:floor(guarantee fit) ·replace-autotrigger(your explicit choice wins) ·off(legacy threshold). - 🎛️ Where compression is decided (precedence, high → low) — per-request
x-omniroute-compressionheader › routing-combo override › active named profile › adaptive / auto-trigger › panel default › off. The applied plan echoes back in theX-OmniRoute-Compression: <mode>; source=<source>response header.
Auto-trigger by token threshold, flip on the adaptive dial, pin a named profile, set a one-off per request, or assign a pipeline per routing combo — whichever fits the workload. An opt-in offline eval harness (npm run eval:compression) scores fidelity vs. savings on a pinned corpus before you promote a change.
📖 COMPRESSION_GUIDE.md · RTK_COMPRESSION.md · COMPRESSION_ENGINES.md
⚡ Quick Start
1) Install & run
npm install -g omniroute
omniroute💡 See npm warn ERESOLVE or peer-dep warnings? They're harmless.
Dashboard at http://localhost:20128 · API at http://localhost:20128/v1.
2) Connect a FREE provider (no signup)
Dashboard → Providers → connect Kiro AI (free Claude, ~50 credits/month per account) or OpenCode Free (no auth) → done.
3) Point your coding tool
Base URL: http://localhost:20128/v1
API Key: [copy from Dashboard → Endpoints]
Model: auto (zero-config smart routing — or any provider/model)4) Verify it's working
curl http://localhost:20128/v1/models -H "Authorization: Bearer YOUR_KEY"You should see your connected models listed. 🎉 That's it — start coding, and OmniRoute auto-routes & falls back for you.
If your client cannot send custom headers, OmniRoute also exposes tokenized compatibility aliases:
OpenAI catalog: http://localhost:20128/vscode/YOUR_KEY/
OpenAI models: http://localhost:20128/vscode/YOUR_KEY/models
OpenAI chat: http://localhost:20128/vscode/YOUR_KEY/chat/completions
OpenAI responses: http://localhost:20128/vscode/YOUR_KEY/responses
Ollama chat: http://localhost:20128/vscode/YOUR_KEY/api/chat
Ollama tags: http://localhost:20128/vscode/YOUR_KEY/api/tagsUse these only for clients that cannot attach Authorization: Bearer .... Header auth remains the preferred mode.
📦 More install methods — Docker, source, pnpm, Arch
🐳 Docker
docker run -d --name omniroute --restart unless-stopped --stop-timeout 40 \
-p 127.0.0.1:20128:20128 -v omniroute-data:/app/data diegosouzapw/omniroute:latest:latest follows the highest published stable SemVer. It does not track git main. Pin :X.Y.Z for GitOps. See Docker Release Channels.The image pins OMNIROUTE_MEMORY_MB=1024. That is enough for the dashboard and a light chat. Coding agents (POST /v1/responses from Claude Code, Codex, Grok, …) need a much larger V8 heap or the process FATAL ERRORs at ~12 GiB under two overlapping long contexts. Size the container above the heap (native buffers sit outside V8):
| Workload | Heap (-e OMNIROUTE_MEMORY_MB) | Container (--memory) |
|---|---|---|
| Dashboard / light chat | 1024 (image default) | ≥2 g |
| One coding agent | 8192 | ≥10 g |
Two concurrent long /v1/responses | 10240–12288 | ≥12–16 g |
docker run -d --name omniroute --restart unless-stopped --stop-timeout 40 \
-e OMNIROUTE_MEMORY_MB=8192 --memory=10g \
-p 127.0.0.1:20128:20128 -v omniroute-data:/app/data diegosouzapw/omniroute:latestFull table: Docker Guide — runtime RAM.
Pre-release Docker channel: diegosouzapw/omniroute:next and
diegosouzapw/omniroute:next-web follow the current default release/v*
branch. These mutable tags are intended only for testing unreleased fixes and
are not supported for production. See
Docker Release Channels.
🥟 Bun
Standard bun install and global installation (bun install -g omniroute) are supported via Bun runtime detection:
- Built-in
bun:sqlite: OmniRoute uses Bun's built-inbun:sqlitedriver when running under Bun, falling back tobetter-sqlite3on Node.js orsql.js. - Automatic Webpack bundler selection in dev: Development (
bun run dev) automatically detects Bun and disables Turbopack in favor of Webpack to prevent native V8 binding incompatibilities. Production builds (bun run build) followOMNIROUTE_USE_TURBOPACKexactly as on Node: Turbopack by default,OMNIROUTE_USE_TURBOPACK=0to build with Webpack (Dockerfile.bunexposes it as a--build-arg). - Dedicated Bun Dockerfile: Multi-stage
Dockerfile.bunfor native Bun production deployments (docker build -f Dockerfile.bun -t omniroute:bun .).
# Install and run with Bun
bun install
bun run dev🛠️ From source
cp .env.example .env && npm install
PORT=20128 npm run dev📦 pnpm
pnpm add -g omniroute@latest --allow-build=better-sqlite3 --allow-build=@swc/core && omniroute🐧 Arch Linux (AUR)
yay -S omniroute-bin && systemctl --user enable --now omniroute.service🔧 Nix (Flake)
# Using Nix flakes
nix develop
npm run dev
# Or using devbox
devbox run npm run dev📖 Docker Guide — Compose profiles, Caddy HTTPS, Cloudflare tunnels.
🦭 Podman
# 1. Prepare the bind-mounted data directory
mkdir -p data
# 2. Linux + local rootless Podman only (never a remote Podman Machine client):
podman unshare chown 1000:1000 ./data
# 3. Set the runtime hint, build the local Compose image, and start
echo "CONTAINER_HOST=podman" >> .env
podman compose --profile base up -d --buildOn macOS or Windows, Podman uses a remote Podman Machine: skip podman unshare and
follow the topology-specific data directory guidance.
📖 Podman Guide — Compose builds, Podman Machine, and Linux/systemd Quadlet setup.
⚡ Faster / leaner install (skip the native build)
The native SQLite engine (better-sqlite3) is an optional dependency, so a global
install never blocks on compiling from source: it uses a prebuilt binary when one matches
your platform/Node, and otherwise falls back transparently to a pure-JS engine
(node:sqlite on Node 22+, else the bundled sql.js WASM) — no build tools required.
To skip the post-install native warm-up entirely (CI, headless, or slow machines):
OMNIROUTE_SKIP_POSTINSTALL=1 npm install -g omniroute # CI=1 also skips itFor the fastest installs prefer pnpm (content-addressed store + hard links — see above).
For a dashboard-free, headless runtime use the Docker base profile (above) or the
Termux guide. The CLI and the web dashboard are served by the
same process on one port, so there is no separate CLI-only package today.
🎬 OmniRoute in Action
📹 Video Guides
Snapshot do painel em 2026-08-24 · Catálogo bruto: YT 809 | TT 137 | IG 124 · Frescor (dias): YT 1 | TT 21 | IG 22

Ranking completo (URLs canônicas deduplicadas, v > 0, maior alcance):
| #1 | #2 | #3 | #4 | #5 |
|---|---|---|---|---|
| nick_saraev — Instagram — 3,042,474 | theopenstack — Instagram — 692,419 | milesreevesai — TikTok — 620,400 | Vaibhav Sisinty — YouTube — 391,109 | buildwithai.club — Instagram — 347,652 |
| #6 | #7 | #8 | #9 | #10 |
|---|---|---|---|---|
| nivedan.ai — Instagram — 331,973 | vaibhavsisinty — Instagram — 263,744 | Nick Automates — YouTube Shorts — 218,174 | theroshankrishna — Instagram — 186,786 | midudev — TikTok — 177,800 |
Métricas canônicas em 2026-08-24: 1.029 vídeos únicos · 11.132.922 visualizações conhecidas (v > 0) · 639 canais/perfis por rede. O painel bruto contém 1.070 linhas; 41 duplicatas do Instagram foram normalizadas pela URL canônica, mantendo a maior contagem por vídeo.
🎬 Made a video about OmniRoute? Open an issue or discussion with the link — we'll feature it here.
📧 Community & Help
Everything in one place — follow the maintainer, chat with the community, or open an issue.
| Channel | Where / how |
|---|---|
| 💼 LinkedIn — follow the maintainer | linkedin.com/in/diegosouzapw |
| 🐙 GitHub — follow for releases & tips | @diegosouzapw |
| 💬 Discord | discord.gg/U47eFqAXCn |
| ✈️ Telegram | t.me/omnirouteOficial |
| 🟢 WhatsApp — 🌍 Global | join the group |
| 🟢 WhatsApp — 🇧🇷 Brasil | entrar no grupo |
| 🌍 Website | omniroute.online |
| 🌍 🌍StHub OmniRoute Community (free) | portal sthub |
| 📦 Source code | github.com/diegosouzapw/OmniRoute |
| 🐛 Report a bug | open an issue — attach npm run system-info output |
| 🤝 Contribute | CONTRIBUTING.md · Branching & Release Model · pick a good first issue |
| 💚 Support the project | Ways to support ↑ · GitHub Sponsors |
🛠️ Tech Stack
📖 Documentation
📘 Getting Started
🔧 Operations & Deployment
🧠 Features & Architecture
🤖 Protocols & APIs
📋 Project & Quality
⭐ Top Contributors
OmniRoute is shaped by a passionate open-source community. These individuals have made exceptional contributions that directly impact the quality, stability, and reach of the project. Thank you.
External contributors by merged pull requests
Frozen at live release/v3.8.50 tip dafb4ae808, with merges through 2026-08-24 05:26:03 UTC. The paginated GitHub GraphQL census contains 5,911 merged PRs: 2,707 by the repository owner, 179 by Dependabot, and 3,025 external PRs from 535 distinct contributors. “Changed lines” is GitHub additions + deletions and includes generated files, lockfiles, catalogs, translations and documentation; it is churn, not authored LOC. Ties at the cutoff are retained.
GitHub-attributed commits











Rechecked at 2026-08-24 06:14:31 UTC: GitHub-attributed commits reported by the repository Contributors API for the release/v3.8.50 default branch. The API returned 525 identities (415 users, 2 bots, 108 anonymous); this table excludes the maintainer, bots and anonymous identities and retains competition ties. It is distinct from both the merged-PR ranking above and the 639-person Git-metadata census below.
🙏 These contributors' features, bug fixes, and infrastructure improvements are a core part of what makes OmniRoute reliable and feature-rich. Every pull request, every test case, and every i18n translation file matters. Open source is built by people like them.
💖 Sponsors
A heartfelt thank-you to the people who fund OmniRoute out of their own pocket — every contribution keeps the project free, independent and moving.





… and others who prefer to stay private 💛
Public GitHub Sponsors revalidated on 2026-08-24. GitHub's activeOnly status determines the active labels above; previously disclosed public one-time supporters remain thanked, and private sponsors remain anonymous.
💖 Become a sponsor → — every dollar keeps OmniRoute free and independent.
👥 600+ Contributors
Audited on 2026-08-24 at frozen base ac02c5b42f and rechecked at live release/v3.8.50 tip dafb4ae808: 639 normalized human Git identities — 407 appear as commit authors (including the maintainer) and 232 only in explicit Co-authored-by trailers. The census normalizes GitHub noreply handles, excludes 26 bot/agent/service/placeholder identities, and does not merge ordinary email addresses merely because their display names match.
How to Contribute
- 1Fork the repository
- 2Branch from the active
release/vX.Y.Ztip (notmain) — see Branching & Release Model - 3Create your feature branch (
git checkout -b feat/amazing-feature) - 4Commit your changes (
git commit -m 'feat: add amazing feature') - 5Push to the branch (
git push origin feat/amazing-feature) - 6Open a Pull Request with base = that
release/vX.Y.Zbranch
See CONTRIBUTING.md for detailed guidelines.
Releasing a New Version
# Create a release — npm publish happens automatically
VERSION=x.y.z
gh release create "v${VERSION}" --title "v${VERSION}" --generate-notes📊 Stars
🌍 StarMapper
🙏 Acknowledgments
OmniRoute stands on the shoulders of giants. It started as a fork of 9router and a TypeScript port of the Go project CLIProxyAPI — and from there, every subsystem below was inspired by an open-source project that got there first. Each one shaped a concrete piece of OmniRoute. This is our thank-you to all of them. 🙏
⭐ star counts verified from GitHub's REST API on August 24, 2026 — go give these projects a star. Counts are an exact dated snapshot and will naturally change.
🧬 Lineage & gateway
🗜️ Context & token compression — engines
🧩 Compact formats, token research & code-aware tooling
🧠 Memory & RAG
🛰️ Traffic inspection, MITM & transparent proxy
📚 Model data, observability & UI
🛡️ Security
🧭 Complementary tools
📄 License
MIT License - see LICENSE for details.
⬆ Back to top · Built with ❤️ for the open-source AI community.
OmniRoute v3.8.51 · Node ≥22.22.2 · MIT License · omniroute.online
