Introduction

In the DeepSeek Harness (DSH) environment, understanding what a model actually did usually relies on the model’s self-reporting about its behavior. This approach is prone to bias. This plugin aims to provide a structured observability layer, replacing model self-reports by recording the tool/skill usage (tools/result) actually captured by the platform, skill catalog audits, and a watchdog with health/error events.

Core Capabilities

This plugin provides the following core features:

  • tools/result listener: The platform records every real tool execution (name + result) into a ring buffer and generates daily aggregated data.
  • agent/error / agent/status: Provides error totals and real-time agent status tracking.
  • Watchdog: A timer-based alert mechanism that triggers when the number of agent errors spikes to the threshold (≥ N) within 5 minutes.
  • Browser dashboard: Registers an “Observation” view tab on the client (located to the right of chat/trajectory), rendering a real-time dashboard from the infraView session projection, including turn counts, failure counts, tool/skill leaderboards, and recent execution records.

Provided Tools

This plugin provides three query tools for both the model and humans:

  1. usage_report: Provides daily aggregated tool/skill data (invocation count / success / error) and recent execution records.
  2. audit_skills: Provides the total skill catalog count, provider distribution, warnings (such as missing descriptions or non-kebab-case naming), and today’s skill usage.
  3. infra_health: Provides uptime, number of retained records, error count, running agents, catalog size, and watchdog status.

Installation and Enablement

Installing this plugin requires adding the package to the DSH configuration.

Add the package name to dsh.profile.bundles in package.json. The package automatically injects the plugin row:

{
  "dsh": {
    "profile": {
      "bundles": ["@bryan-cmf/dsh-infra-observability"]
    }
  }
}

Method B: Agent Preset Row

Specify the package name in the Agent preset configuration:

- id: infra-observability
  name: '@bryan-cmf/dsh-infra-observability'

Notes and Dependencies

  • Dependency Requirement: This plugin requires DSH version >= 0.1.0-rc.6.
  • Data Lifecycle: Aggregated data is based on the process lifecycle (consistent with dsh-skill-trail).
  • Persistence Plan: Persistence across restarts is planned.
  • Companion Package: @bryan-cmf/dsh-skill-trail is the companion backend layer used to render the badge line for each reply.
  • Project Status: This suite was merged into @bryan-cmf/dsh-insights on 2026-08-17. The current repository only retains the pre-merge historical records. For future iterations, please go to dsh-insights.

Ecosystem Context

DSH follows the “everything is a plugin” philosophy. The plugin can be found in the skill catalog: dsh-infra-observability.