How long does the integration take?

Change one base URL in an OpenAI-compatible client, or install the Python or TypeScript SDK; the quickstart routes a first request in a few minutes.

Will this lock us into another vendor?

No. The router is Apache-2.0 open source, your provider keys stay yours, and the API is OpenAI-compatible, so leaving is a change of base URL.

What happens when a provider fails?

The router falls back to the next model your policy allows and records the fallback in the trace, so an outage costs a retry, not an incident.

cost-local - Skill - OpenSmartRoute

Name: cost-local
Author: ruvnet

Imported from ruvnet/ruflo (plugins/ruflo-cost-tracker/skills/cost-local/SKILL.md). Install upstream with npx skills add ruvnet/ruflo --skill cost-local. Copyright stays with the author.

Cost Local

node ${CLAUDE_PLUGIN_ROOT}/scripts/local-cost.mjs --tok-per-s 80 --busy 0.25 --compare claude-haiku-4-5

Inputs (all the user's): --watts-idle, --watts-active, --kwh, --hw-price, --life-years, --resale. --tok-per-s is required and must be a measured generation speed.

Rules

Cost = fixed (amortisation + idle power, paid busy or not) + marginal (extra watts while generating). Utilisation decides the answer: always show the table at 5/25/50/100% busy.
It is an estimate from the inputs; say so. Nothing is measured.
Compare against a same-capability hosted model, not a frontier one; price alone is a poor reason to buy a GPU for sporadic use.
Read real counts from the server (Ollama eval_count/prompt_eval_count on the native API, llama.cpp timings, vLLM /metrics), not the lossy OpenAI-compatible usage, and count model reloads (load_duration) as overhead.

Install cost-local and it becomes one more candidate the router can pick - when it fits.

A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.

{ "ocm": "1", "id": "ruvnet-ruflo-cost-local", "kind": "skill", "name": "cost-local", "description": "Cost per million tokens on hardware you own (Ollama, llama.cpp, vLLM, LM Studio) from watts, electricity price, hardware price and measured tokens/second, and the utilisation at which local beats a hosted model. Use for local-vs-API break-even questions.", "publisher": "ruvnet", "version": "1.0.0", "capabilities": { "domains": [ "coding", "creative" ], "tags": [ "skill-md", "skills-sh" ], "languages": [ "en" ] }, "quality_prior": 0.6, "examples": [ "Cost per million tokens on hardware you own (Ollama, llama.cpp, vLLM, LM Studio) from watts, electricity price, hardware price and measured tokens/second, and the utilisation at which local beats a hosted model. Use for local-vs-API break-even questions." ], "primary": false, "metadata": { "source": { "provider": "skills.sh", "repository": "https://github.com/ruvnet/ruflo", "path": "plugins/ruflo-cost-tracker/skills/cost-local/SKILL.md", "ref": "HEAD", "url": "https://github.com/ruvnet/ruflo/blob/HEAD/plugins/ruflo-cost-tracker/skills/cost-local/SKILL.md", "key": "ruvnet/ruflo/plugins/ruflo-cost-tracker/skills/cost-local/SKILL.md" }, "allowed_tools": [ "Bash" ] }, "instructions": "# Cost Local\n\n```bash\nnode ${CLAUDE_PLUGIN_ROOT}/scripts/local-cost.mjs --tok-per-s 80 --busy 0.25 --compare claude-haiku-4-5\n```\n\nInputs (all the user's): `--watts-idle`, `--watts-active`, `--kwh`, `--hw-price`, `--life-years`, `--resale`. `--tok-per-s` is required and must be a **measured** generation speed.\n\n## Rules\n\n- Cost = **fixed** (amortisation + idle power, paid busy or not) + **marginal** (extra watts while generating). Utilisation decides the answer: always show the table at 5/25/50/100% busy.\n- It is an estimate from the inputs; say so. Nothing is measured.\n- Compare against a sam", "cost": { "context_tokens": 234 } }

cost-local

About

Cost Local

Rules

Use it

Install cost-local and it becomes one more candidate the router can pick - when it fits.

What it costs to adopt - in engineering time.

One base URL

No vendor lock-in

Failover built in

Manifest

Reviews