dsh-windtunnel

Building DSH plugins often means there is no reproducible way to regression-test before release: real model calls require network access and an API key, behave non-deterministically, and simply cannot run in CI. dsh-windtunnel swaps the LLM decision layer for an in-process scripted adapter while keeping the agent loop, tool registry, parameter validation, rendering, event stream, and persistence fully real, turning plugin testing into a zero-key, zero-network, deterministic contract regression you can drop straight into CI.

Coverage spans four layers: load probes (double-apply idempotency, non-ctx footprint diff), contract checks (schema subsets through the real registry, render completeness, timeout-cancel response, fuzz on malformed input), behaviour assertions (scripted typed tool-call followed by a full session-event sequence assertion), and fault injection (missing-parameter predictable failure, concurrent re-entry via Promise.allSettled). The bundle under test always runs in an isolated subprocess so a crash kills only the child while the harness survives to emit a report; expectFail negative cases invert the pass criterion so red is the correct outcome.

Ideal for developers writing or maintaining DSH plugins who need stable CI coverage of render gaps, cancel-contract violations, and race conditions. Keep in mind the windtunnel is a contract regression net, not a utility test bed: it proves the pipeline emits the right event stream given a tool call, not that a real model will proactively and correctly invoke the tool.