AI Agent Hub
Back to plugins
🤖

dsh-smart-route

Model Inference Updated 2026.08.25

Run the following command in DeepSeek Harness:

dsh plugin install Semidia/dsh-smart-route

Paste the following prompt into your AI chat to install this plugin:

Run dsh plugin install Semidia/dsh-smart-route in the DeepSeek Harness terminal to install the smart routing plugin; the full source repository is at https://github.com/Semidia/dsh-smart-route .

About this plugin

Running multiple model suppliers through polyglot inside DeepSeek Harness Web hits a few practical walls: only rate-limit and 5xx errors trigger a switchover, while 4xx auth or invalid-request errors go straight back to the user; there is no quick way to disable routing mid-session; and the model picker gets cluttered with duplicated entries from every channel. dsh-smart-route rebuilds the routing layer to address all four of those pain points. Any error from any channel—INVALID_REQUEST, AUTH, HTTP transport failures, timeouts—automatically cools that provider and advances forward in the chain, so failover is truly comprehensive and silent.

The core mechanism is an ordered channel chain: providers are called in sequence, and a failed one enters an exponential-backoff cooldown window (with jitter) during which it is skipped. A persistent capsule button sits next to the model selector in the composer, showing a green dot when active; clicking it reveals the default chain, available channels, and any currently cooling, with a one-tap toggle to enable or disable routing entirely. The settings card lets you create, delete, or switch between multiple chains. Each channel can optionally declare its own baseUrl and apiKeyEnv—channels with a baseUrl go through a built-in OpenAI-compatible SSE dispatcher, while those without reuse the DSH-registered provider pipeline. The plugin registers a single virtual provider called smart-route, keeping the model picker clean no matter how many real suppliers the chain spans.

It is built for anyone juggling two or more model suppliers in DSH and wants seamless, silent cross-channel failover without being interrupted by transient API errors. Whether you are balancing official and mirror endpoints in a daily dev workflow or needing resilient inference under unstable network conditions, smart-route handles the routing quietly in the background so your conversation keeps flowing.

Use Cases

  • Multiple suppliers connected and one intermittently fails
  • routing moves to the next provider without interrupting the conversation.
  • Unstable network causes repeated timeouts
  • the cooldown backoff mechanism prevents hammering a broken channel.

Best For

  • Developers juggling two or more model endpoints in DSH and wanting automatic failover on errors.
  • Teams that want transient API errors to never break the conversation flow.
  • Users dissatisfied with polyglot limited error coverage and seeking a more comprehensive routing strategy.