AI Agent Hub
Back to plugins
⚙️

dsh-verify-judge

Workflow Updated 2026.08.15

Run the following command in DeepSeek Harness:

dsh plugin install zriyox/dsh-verify-judge

Paste the following prompt into your AI chat to install this plugin:

Install by running dsh plugin install zriyox/dsh-verify-judge in DeepSeek Harness; source code is available at https://github.com/zriyox/dsh-verify-judge

About this plugin

Autonomous goal loops let an AI agent run many rounds on its own, but the moment it says "I'm done" has always been pure self-declaration — a model can stamp complete while tests are still red. dsh-verify-judge closes that trust gap: it turns marking a goal complete from a chat statement into a gated action with an objective pass/fail gate.

The mechanism is straightforward. When the agent calls update_goal(complete), the plugin first runs the project's test suite (auto-detected or explicitly configured). Red tests mean the completion is denied, and the failing command output is fed back to the agent as instructions to keep fixing. Version 0.2.0 adds a turn-end gate: even if the agent tries to skip the formal stamp and simply declare done in prose, the plugin re-verifies at the turn boundary and sends it back to work. When everything genuinely passes, the agent never notices the plugin exists; when it tries to cut corners, it gets bounced back — twice by default, then stopped.

It is built for developers running DeepSeek Harness in goal mode who let an agent autonomously complete multi-step tasks. If your agent occasionally turns in half-finished work early, this plugin adds an objective completion standard with minimum intrusion — no prompt changes, no workflow restructuring. Enable the row and the gate goes live; disable it and behavior returns to stock.

Use Cases

  • Back an agent completion claim in autonomous goal loops with passing test evidence
  • Prevent premature completion stamps while the test suite is still red
  • Insert an objective pass or fail check into unattended multi-round agent workflows

Best For

  • Developers running DeepSeek Harness goal mode to let an agent complete multi-step tasks
  • Teams that require hard quality gates on agent deliverables and want objective verification
  • Solo developers adding a local test gate to agent-driven workflows