dsh-llm-eval
Run the following command in DeepSeek Harness:
dsh plugin install satan9394/dsh-llm-eval
Paste the following prompt into your AI chat to install this plugin:
Run dsh plugin install satan9394/dsh-llm-eval in DeepSeek Harness to install this plugin; the full source code is available at https://github.com/satan9394/dsh-llm-eval .
About this plugin
dsh-llm-eval is a DeepSeek Harness plugin focused on LLM evaluation within the model-inference category. When building LLM integrations on the Harness framework, developers often lack a dedicated evaluation entry point to measure inference-side performance. This plugin fills that gap by plugging an LLM evaluation step directly into the Harness workflow.
It ships as a lightweight, MIT-licensed plugin that slots into the existing DeepSeek Harness pipeline, so you can invoke evaluation capability without leaving your current development environment. The project is open source and free to integrate or extend in any project.
It is best suited for developers and teams who are already using DeepSeek Harness to build LLM applications and now want to add a structured evaluation step to their inference pipeline. If your basic inference flow is already working and all you need is a clean evaluation entry point, dsh-llm-eval is a practical starting point.
Use Cases
- Adding an LLM inference evaluation step to a DeepSeek Harness pipeline
- Performing structured quality assessment on model inference outputs
- Comparing different inference configurations within a Harness workflow
Best For
- Developers building LLM applications on DeepSeek Harness
- AI engineering teams that need an evaluation step in their inference pipeline
- AI developers exploring the Harness plugin ecosystem
Related Plugins
ModLens is a vision plugin for DeepSeek Harness that gives text-only models sight by reading images pasted directly into chat, with zero-config setup and multiple vision engines.
On-demand vision for text-only DeepSeek Harness agents: built-in free keyless vision chain and 14 vision tools, routing image turns as tool calls to vision models with pixel fidelity, no Python needed, one-command install.
Give text-only models in DeepSeek Harness eyes, enabling image Q&A, long-screenshot OCR, UI restoration, and GUI visual tasks.
An armor-breaking plugin for DeepSeek: rewrites instruction priority, expands refusal-blocked phrases, persists across sessions, and shows a green active indicator.