Introduction

When debugging agents in DeepSeek Harness (DSH) Web, directly inspecting model requests and responses often requires modifying code or relying on external tools. The dsh-llm-call-inspector plugin provides a local, session-scoped inspector. It adds an “LLM Calls” view alongside the Chat and Trajectory views, allowing developers to inspect every normalized llm/stream call associated with a session without changing what the model receives or what the caller receives.

Plugin Introduction

This is an open-source plugin maintained by community developer striveh, designed to address the lack of native LLM call observability in DSH Web. It helps developers quickly locate issues by intercepting and displaying normalized call data.

Core Features

The plugin mainly provides the following capabilities:

  1. LLM Calls View
    Adds a view to the DSH Web interface, alongside Chat and Trajectory. It displays all calls from the current session in newest-first order.

  2. Call Details Display
    List items include detailed information such as Provider, Model, Purpose, Status, Start Time, Duration, Chunk Count, and Body-capture State.

  3. Filtering and Search
    Supports searching the call list and filtering by Status and Purpose to quickly locate specific calls.

  4. Master/Detail Layout
    Click a call in the list to open the details page. The details page uses a Master/Detail layout with three tabs: Request, Response, and API Comparison.

    • Request / Response: Displays captured request and response data, with support for expanding JSON and copying content.
    • API Comparison: Provides semantic projection to compare the request with standard API shapes (supports protocols such as OpenAI, Anthropic, Google, Bedrock, and Mistral).
  5. Context Preservation
    When switching between different views (for example, from LLM Calls to Chat and back), the plugin preserves the current inspection context, including selected call, search keywords, filters, details tab, and scroll position.

  6. Data Capture
    By default, the plugin captures request and response bodies. Captured request fields include: provider, model, reasoningEffort, messages, system, tools, temperature, maxTokens, stop, sessionId, and purpose. Captured responses are ordered DSH StreamChunk values.

Notes

  1. Version Compatibility: This plugin currently only supports DeepSeek Harness version 0.1.2-alpha.2. If you are using an older version (such as 0.1.0-rc.8), please use plugin version v0.2.0.
  2. Privacy and Data Security: The plugin captures request and response bodies by default, which may include prompts, source code, tool arguments, sensitive data, or personal information. Before using sessions involving sensitive information, please read the privacy documentation and assess the risks.
  3. Scope: The plugin only monitors data within the DSH normalization boundary; it is not a wire proxy for providers. It does not capture raw HTTP request or response packets.
  4. Storage Mechanism: The plugin uses an in-memory browser cache and does not use localStorage, sessionStorage, or IndexedDB. When the plugin lifecycle ends, the client cache will be cleared.
  5. API Comparison Limitations: API Comparison is semantic projection rather than packet capture. It does not read HTTP headers or API keys, nor does it send additional requests.

Acquisition and Installation

No specific installation command is currently provided. You can obtain the plugin through the following links:
* Plugin catalog: https://www.skillhub.cn/plugins/striveh/dsh-llm-call-inspector
* Source repository: https://github.com/striveh/dsh-llm-call-inspector

Summary

dsh-llm-call-inspector is a tool focused on session-level LLM call observability. Through semantic projection and context preservation, it provides an intuitive debugging method for DSH Web users. Within the scope of its privacy and data capture behavior, it can effectively assist developers with agent development and debugging.