Canonical: https://botbento.com/usecases/optimizing-multi-model-routing-from-telemetry-traces/
Format: Markdown representation of the public HTML page.

[Home](/) / [Use cases](/usecases/) / [Operations](/usecases/?category=ops)

Operations · Advanced

# Optimizing multi-model routing from telemetry traces

Analyze prompt logs and latency metrics to recommend cost-effective model routing rules

[Use with BotBento ](https://app.botbento.com/?ref=usecases&utm_source=botbento.com&utm_medium=usecases&utm_campaign=optimizing-multi-model-routing-from-telemetry-traces)Copy promptShare[Markdown](/text/usecases/optimizing-multi-model-routing-from-telemetry-traces/index.md)[العربية](/ar/usecases/optimizing-multi-model-routing-from-telemetry-traces/)

Opens BotBento. Paste the prompt into a bot; nothing is preconfigured.

- On a scheduleWeekly telemetry review
- ThenAnalyze prompt traces and costs
- ResultSubmit routing rule pull request

This bot inspects telemetry traces and query logs from your inference gateway, clusters common prompt archetypes, and evaluates candidate models to balance cost against latency and accuracy. It drafts routing policies and cache configuration changes to optimize resource utilization across self-hosted and cloud providers.

## Prompt to start with

BotBentoRecommended

```
Query the gateway telemetry database to extract sample prompt traces, token usage, and response latencies across active providers. Group requests by task complexity and test candidate fallback models against standard quality checks. When you identify cheaper or faster alternatives that maintain acceptable quality thresholds, draft updated routing configuration files. Always wait for human approval before opening a pull request on GitHub or applying any routing updates to live gateway environments.
```

Copy

## Tools it uses

DatabaseTerminalGitHubChat

## Works with

BotBento

## Tags

- llm
- routing
- gateway
- cost-optimization
- telemetry

## Source

[Show HN: We built open OpenRouter that turns usage into a better model](https://news.ycombinator.com/item?id=49471407)
Hacker News · checked 2026-10-15

Summarized in our own words. Any results described there are the authors’ own, not measured by BotBento.

By BotBento Editorial · Added 2026-10-15 · Updated 2026-10-15 · [Suggest a correction](/contact/)

## Related use cases

-

Operationsadvanced

## [Coding agent model routing and cost optimizer](/usecases/coding-agent-model-routing-and-cost-optimizer/)

Direct development agent prompts to suitable language models based on task complexity and budget

TerminalGitHubDatabaseSlack
-

Operationsintermediate

## [Auditing model usage logs to downgrade simple tasks](/usecases/auditing-model-usage-logs-to-downgrade-simple/)

Inspect query traces to identify routine calls that can run on smaller models

TerminalSpreadsheetDocs
-

Operationsintermediate

## [Model gateway routing and quota monitor](/usecases/model-gateway-routing-and-quota-monitor/)

Balance inference traffic across provider endpoints and manage quota fallbacks

TerminalDatabaseChat