Answers from the documentation; checking which model is on duty
Hi - I answer from the OpenSmartRoute documentation: routing, the API, plans and quotas, self-hosting. Ask away, or open a support ticket if you need a person.
Grounded in the docs - follow a source before acting on it.
Starter stack - Template - OpenSmartRoute
TemplateFeaturedv1.0.0
Starter stack
Three models, two rules: quality first, private data stays on-prem. Apply in a minute.
Three models and two rules that cover most teams' first month:
Target
Used for
llm-small
everyday questions, summaries, drafts
llm-frontier
hard reasoning, long documents, code
llm-onprem
anything with personal or regulated data
pii-stays-home pins requests that contain personal data to the on-prem model; hard-goes-frontier sends
complex requests to the frontier model. Everything else lands on the small model, which is where the savings
come from.
Apply it
osr stack plan registry://starter@1.0.0 --registry https://your-platformosr stack apply registry://starter@1.0.0 --registry https://your-platform --route "Summarise this contract"
Rename the targets to your own deployments, keep the rules.
Use it
Copy one of these into your project. Installing also returns the manifest and these snippets.
Installed into a catalogue, chosen by a router
Install Starter stack and it becomes one more candidate the router can pick - when it fits.
A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.
