AI Agent Hub
Back to plugins
🤖

dsh-gateway-provider

Model Inference Updated 2026.08.25

Run the following command in DeepSeek Harness:

dsh plugin install Luck9Star/dsh-gateway-provider

Paste the following prompt into your AI chat to install this plugin:

Run dsh plugin install Luck9Star/dsh-gateway-provider inside DeepSeek Harness to install the plugin; the full source code repository is at https://github.com/Luck9Star/dsh-gateway-provider .

About this plugin

DeepSeek Harness provides one adapter per official provider out of the box. The moment your models are served through a gateway like newapi, LiteLLM, Higress, or any other OpenAI-compatible endpoint, you are left to hand-maintain a static model list with guessed context windows and output caps. dsh-gateway-provider replaces that fragile setup by attaching directly to the gateway: it fetches the live catalog at startup, cross-references every model against models.dev for real parameters, and reflects new gateway models instantly—no re-deploy, no YAML wrangling.

Under the hood each request is translated into the native wire protocol of the model you picked—OpenAI Chat Completions, OpenAI Responses, Anthropic Messages, or Gemini—using the same pi-ai SDK that powers the official dsh adapter, so tool calls and streaming behave exactly the way the model's maker intended. You can register multiple gateways side by side, each with its own route, API key, and 30-minute catalog cache. Fine-grained per-model controls (protocol pinning, context window, output cap, reasoning levels, include/exclude) are all available through the Settings → Gateway Models web page, and API keys are written into dsh's credential store rather than living in a config file.

This plugin is aimed at teams and power users who route large model portfolios through an LLM gateway, need each model to speak its own protocol for reliable tool calling and streaming, and want to retire the manual model-list maintenance that static adapters force upon them. One gateway API key is all it takes to make every catalog model appear in the dsh picker with correct parameters.

Use Cases

  • Pull multi-vendor models into dsh through a single newapi or LiteLLM gateway
  • Route each request over the model's native protocol so tool calls and streaming behave as intended
  • Manage multiple gateways, test connections, sync catalogs, and tune per-model settings from the dsh web UI

Best For

  • Engineering teams routing dozens or hundreds of models through an LLM gateway
  • Application developers who need per-model native protocols for tool calls and streaming
  • Individual users who want to stop hand-maintaining static model lists and guessed parameters