Answers from the documentation; checking which model is on duty
Hi - I answer from the OpenSmartRoute documentation: routing, the API, plans and quotas, self-hosting. Ask away, or open a support ticket if you need a person.
Grounded in the docs - follow a source before acting on it.
Llama 3.1 70B Instruct - Model - OpenSmartRoute
Modelv1.0.0
Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Reference model card from the OpenRouter listing - model meta-llama/llama-3.1-70b-instruct. Prices are per million tokens as listed; ratings and installs below are from this marketplace.
Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Facts
Vendor
Meta
Context window
131,072 tokens
Max output
16,384 tokens
Input price
$0.40 / 1M tokens
Output price
$0.40 / 1M tokens
Input
text
Output
text
Tool calling
yes
Structured outputs
yes
Reasoning
no
Open weights
meta-llama/Meta-Llama-3.1-70B-Instruct
Endpoint: https://openrouter.ai/api/v1 (OpenAI-compatible), model meta-llama/llama-3.1-70b-instruct
Use it
Copy one of these into your project. Installing also returns the manifest and these snippets.
# after Install: the listing is in your workspace's routing pool - nothing else to configurecurl-s-X POST https://osr-api.kindrock-caaab1a2.centralindia.azurecontainerapps.io/api/v1/route -H 'Authorization: Bearer $OSR_API_KEY' -H 'Content-Type: application/json' -d '{"text": "...", "plan": true}'# or pin it on the OpenAI-compatible endpoint: {"model": "model-meta-llama-llama-3-1-70b-instruct", ...}
Installed into a catalogue, chosen by a router
Install Llama 3.1 70B Instruct and it becomes one more candidate the router can pick - when it fits.
A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.
