AI Agent Hub
Back to plugins
🤖

dsh-llm-proxy

Model Inference Updated 2026.08.25

Run the following command in DeepSeek Harness:

dsh plugin install superfish058/dsh-llm-proxy

Paste the following prompt into your AI chat to install this plugin:

To install this plugin in DeepSeek Harness, run the command `dsh plugin install superfish058/dsh-llm-proxy`; the full source code is available at https://github.com/superfish058/dsh-llm-proxy.

About this plugin

Accessing international large language model APIs from within China often results in connection timeouts or unreachability, and free API quotas are frequently disrupted by transient errors like HTTP 429 rate limiting or 5xx server errors. The dsh-llm-proxy plugin addresses these issues with an intelligent proxy solution. Its core capability is routing requests based on the target domain of each model: users select which models should go through the proxy, and the plugin automatically forwards those requests via a specified proxy (e.g., Clash), while others connect directly, avoiding the impact of a global proxy on domestic APIs. It also includes automatic retry on failure for disconnections, rate limiting, and server errors to preserve free quotas, along with multimodal model mirroring and a test connection feature for easy verification. This plugin is particularly useful for developers needing to access international model APIs, especially those relying on free quotas but hindered by network restrictions, as well as users wanting fine-grained control over proxy settings to optimize network performance and costs.

Use Cases

  • When accessing overseas model APIs from China times out or is unreachable.
  • When free API quotas are interrupted by HTTP 429 rate limiting or 5xx errors.
  • When needing per-model proxy control instead of a global proxy affecting domestic APIs.

Best For

  • Developers needing to access international LLM APIs.
  • Users relying on free API quotas but hindered by network restrictions.
  • Users seeking fine-grained proxy management to optimize network performance.