AI Agent Hub
Back to plugins
🤖

dsh-model-router

Model Inference Updated 2026.08.28

Run the following command in DeepSeek Harness:

dsh plugin install andrepontesmelo/dsh-model-router

Paste the following prompt into your AI chat to install this plugin:

Run dsh plugin install andrepontesmelo/dsh-model-router in your terminal to install the plugin, source at https://github.com/andrepontesmelo/dsh-model-router

About this plugin

In the real world, model pools are the norm: a cheap fast one, a strong one, a spare. The problem is that hardcoding a single model ID means any single provider outage becomes your outage. dsh-model-router pulls routing out of the harness core: declare a virtual model ID that looks identical to a real model in the picker, backed by a candidate pool and a routing algorithm that decides where each call actually lands.

The headline experience is transparent failover. When a candidate times out or errors, the plugin re-dispatches the same request to the next candidate with no user-visible error. Meanwhile the response provenance honestly records which real model produced the answer and which candidates are still cooling down in their backoff window. Two built-in algorithms ship out of the box: priority always tries the first candidate and applies exponential backoff on failure, giving a struggling model time to recover; round-robin distributes calls evenly across the pool. For custom strategies, the RoutingAlgorithm factory exposes select, onFailure, onDispatch, and onSuccess hooks — implement one, register it, and the rest of the harness never needs to know.

It fits a very concrete scenario: you span two or three providers, your agent workflow needs at least one model always reachable, and you do not want to hand-roll retry logic for every failure. One route declaration is all it takes; the algorithm handles the rest.

Use Cases

  • Distribute model calls across providers via priority or round-robin routing
  • Silently fail over to a backup model when one candidate errors in an agent workflow
  • Register a custom routing algorithm for cost- or latency-aware dispatch

Best For

  • Developers spanning multiple AI providers
  • Engineers building agent workflows that require model resilience
  • Developers who want custom routing logic without modifying the harness core