AI Agent Hub
Back to plugins
🤖

dsh-plugin-mlquant-benchmark

Model Inference Updated 2026.08.25

Run the following command in DeepSeek Harness:

dsh plugin install initial-d/dsh-plugin-mlquant-benchmark

Paste the following prompt into your AI chat to install this plugin:

Run dsh plugin install initial-d/dsh-plugin-mlquant-benchmark in your DeepSeek Harness terminal; the repository is at https://github.com/initial-d/dsh-plugin-mlquant-benchmark.

About this plugin

Running and reporting a quant benchmark inside DeepSeek Harness used to mean juggling fixed seeds, panel sizes, thread counts, JSON field checks, and a rigid issue template by hand. dsh-plugin-mlquant-benchmark collapses that whole workflow into four DSH tools that operate on the ml-quant-trading protocol v1 CPU benchmark: execute the fixed-parameter run and emit benchmark-v1.json, render the JSON artifact as a compact Markdown table, validate every required protocol field and flag variance warnings, and draft an issue-ready report body from the artifact without ever posting to GitHub. The plugin is deliberately narrow—it adds no trading agent, calls no market-data API, configures no model provider, and makes no backtest or performance claims—so the throughput numbers stay evidence, not alpha. It is built for quant and agent engineers who want a reproducible, end-to-end benchmark-to-report path inside DSH without pulling in heavyweight infrastructure.

Use Cases

  • Run, validate, and draft a protocol v1 CPU benchmark report for ml-quant-trading in a single DSH prompt
  • Check that benchmark-v1.json carries the correct fixed parameters, expected cases, and variance warnings per protocol v1
  • Generate an issue-template-ready Markdown report body from the JSON artifact without manual formatting

Best For

  • Quant research engineers who want a reproducible benchmark pipeline inside DSH
  • DeepSeek Harness developers adding deterministic tooling for agent workflows
  • Open-source maintainers standardizing benchmark evidence for public issue reports