Introduction¶
In DeepSeek Harness (DSH), an agent request usually lands on a specific provider route. If this route returns 429, times out, encounters a transmission error, or has credential/quota issues, the current turn might fail directly. Existing retry strategies often focus on limited recovery within the same route. If a user has multiple authorized routes for the same model, they want the request to switch to a still healthy route, while isolating bad credentials, bad quotas, or bad routes.
dsh-route-resilience solves this multi-route availability issue: it organizes user-authorized provider routes into model groups, distributes requests among healthy routes, and switches to the next route when retryable errors occur. Below is an introduction to its positioning, features, installation, typical usage, and notes.
Positioning¶
dsh-route-resilience is a DSH plugin for multi-route high availability, fault isolation, and observability. The maintainer is lokic7123-star with an MIT license.
It is not a quota workaround. It does not bypass quotas, rate limits, or fair-use caps, nor does it support multi-account or multi-identity circumvention of provider limits. It only uses user-authorized credentials and routes; each route is still bound by its provider’s terms of service. The plugin references provider routes by name without reading, writing, or exposing key material.
Core Features¶
Multi-Route and Failover¶
The plugin provides the following verified capabilities:
- Model groups: Organizes multiple provider routes serving the same model into a single group.
- Round-robin allocation: New requests are allocated among healthy routes in an active group using a round-robin approach.
- Retryable failover: When a retryable error is encountered, the request can switch to the next route.
- 429 / Retry-After handling: Handles
429 / Retry-Afterscenarios for rate limiting. - Auth / quota isolation: Isolates auth or quota exceptions to prevent an anomalous route from affecting the entire group.
- Fallback: Provides a fallback mechanism to avoid deadlock when all routes are unavailable.
Observability and Management¶
The plugin also provides the following entry points:
- Observability: Provides a read-only status endpoint
GET /api/dsh-route-resilience/status. - Web settings panel: Provides a “Route resilience” panel on the Models page for managing groups, keys, and quarantine parameters.
Installation and Activation¶
Installation¶
The npm installation command provided in the documentation is:
npm install dsh-route-resilience
The documentation does not confirm the npm release status. If the current environment lacks an installable npm package, you can obtain the source code from the GitHub repository and integrate it as a DSH profile plugin. The repository address is:
https://github.com/lokic7123-star/dsh-route-resilience
Enabling in Profile¶
To enable it, two steps must be completed in the profile’s package.json:
- Add
dsh-route-resiliencetodsh.profile.bundles. - Add a
link:dependency pointing to the local plugin directory.
It can be written in a form similar to the following:
{
"dsh": {
"profile": {
"bundles": ["dsh-route-resilience"]
}
},
"dependencies": {
"dsh-route-resilience": "link:/path/to/plugins/dsh-route-resilience"
}
}
The /path/to/plugins/dsh-route-resilience here should be replaced with the actual directory path where the plugin is stored. After the above steps, the plugin enters the DSH profile’s load path.
Typical Usage¶
Configuring settings namespace¶
The plugin reads configuration from the dsh-route-resilience settings namespace. Below is an example structure:
{
"groups": [
{
"id": "deepseek",
"targets": [
{ "provider": "route-a", "model": "deepseek-chat" },
{ "provider": "route-b", "model": "deepseek-chat" }
],
"retryableCodes": ["RATE_LIMIT", "TIMEOUT", "TRANSPORT"],
"quarantineBaseMs": 60000,
"quarantineCapMs": 300000
}
],
"activeGroup": "deepseek"
}
Where:
groupsdefines one or more model groups.targetslists the provider routes and models within the group.retryableCodesspecifies the error codes that trigger failover.quarantineBaseMsandquarantineCapMsare used for quarantine parameters.activeGroupis an optional field; whenactiveGroupis not set, the plugin is in an “installed but idle” state, and routing passes through unchanged.
Viewing Status¶
The plugin provides a read-only status endpoint:
GET /api/dsh-route-resilience/status
This endpoint is used to view the current route health status. The documentation notes that this status route is read-only, shares the same domain as the served web UI, and is restricted from remote browser access by the host trust fence.
Using the Web Panel¶
A “Route resilience” panel appears at the bottom of the Models page. You can manage groups, keys, and quarantine parameters within it. This panel is used for daily viewing and adjusting multi-route strategies. On the plugin side, provider routes are still only referenced by name without exposing key material.
Applicable Scenarios and Notes¶
This plugin is suitable for the following scenarios:
- You have multiple authorized provider routes and want to ensure availability for the same model across multiple routes.
- You want to isolate route-level failures such as
429 / Retry-After, transmission errors, and auth/quota anomalies. - You desire a read-only status interface and a web panel to monitor route health.
- You want to extend routing behavior via a plugin without modifying the DSH core source code.
Please note:
- It does not bypass quotas, rate limits, or fair-use caps.
- It does not support multi-account or multi-identity circumvention of provider limits.
- It only uses user-authorized credentials and routes; each route remains bound by its provider’s terms of service.
- It does not read, write, or expose key material, only referencing provider routes by name.
- Requires DSH
>= 0.1.0-rc.5and Cordis>= 4.0.1. - The plugin runs with the current DSH process permissions. Before installing, you should check the source code,
MITlicense, dependency versions, and actual configuration.
Conclusion¶
The value of dsh-route-resilience lies in: when a specific provider route experiences rate limiting, failure, or authorization anomalies, allowing DSH to continue serving requests from other authorized routes instead of failing the entire request. It turns multi-route high availability, fault isolation, and observability into a DSH plugin.
The community directory is an independent site with no official affiliation with DeepSeek / Huafan; this article does not confirm the directory page URL. The repository address is:
https://github.com/lokic7123-star/dsh-route-resilience