Introduction

When deploying LLMs locally (e.g., Ollama) and orchestrating them through DeepSeek Harness (DSH), a convenient way is needed to monitor service status, test model performance, and manage model resources. The dsh-plugin-ollama-monitor plugin integrates monitoring and evaluation capabilities into the DSH ecosystem, eliminating the need to manually switch between terminal and Web interfaces, and providing a unified toolchain for agent development.

Plugin Overview

  • Name: dsh-plugin-ollama-monitor
  • Core Value: Ollama monitoring and evaluation platform
  • Maintainer: LouisCanBe
  • License: MIT
  • Category: Workflow

Core Features

This plugin uses a hybrid architecture combining a Node side and a Web side:

  1. Node Side (Agent Tools): Provides the DSH Agent with tools, including:
    • Service status checking
    • Model speed testing
    • Model pulling and management
    • Programming evaluation
  2. Web Side (Interactive Panel): Provides a visual interactive panel in the DSH settings page for direct operations and status viewing.

Installation and Enabling

Prerequisites: The dsh CLI is installed locally.

Run the following command to install the plugin:

dsh plugin --profile web add ollama-monitor

After installation, you must restart the profile. Adding or removing DSH bundles requires a restart, while subsequent patch changes support hot reloading.

Configuration

The plugin’s row id is ollama-monitor, and the default configuration is located in cordis.patch.yml inside the package.

Default Configuration Items

  • host: http://127.0.0.1:11434 (Ollama service address)
  • defaultModel: '' (default selected model in the panel)
  • defaultPrompt: 用一句话解释什么是操作系统。 (default speed-testing prompt)
  • numPredict: 128 (default maximum number of generated tokens)
  • timeoutMs: 300000 (request timeout in milliseconds; the default is relaxed to handle cold loading of large models)

Override Configuration

Override configurations must be written to ~/.dsh/cordis.patch.yml or the profile layer. Note: the patch mechanism replaces the entire config, so all keys must be restated.

- id: ollama-monitor
  config:
    host: 'http://127.0.0.1:11434'
    defaultModel: ''
    defaultPrompt: '用一句话解释什么是操作系统。'
    numPredict: 128
    timeoutMs: 300000

Verification and Uninstallation

Verify that the configuration is in effect:

dsh --profile web --dump-config

If you need to uninstall it:

dsh plugin --profile web remove ollama-monitor

Notes

  1. Bundle Changes: After installing or uninstalling a plugin, you must restart the profile for changes to take effect.
  2. Build Dependencies: If installing directly from a Git repository, pnpm >=10 refuses by default to run the prepare build script for git dependencies. This repository has committed the built lib/, which can be used directly. If rebuilding from source, add allowBuilds: ollama-monitor: true to the profile’s pnpm-workspace.yaml.
  3. Configuration Completeness: When modifying configuration, the patch file must restate all keys inside the config object; otherwise, configuration loss or conflicts may occur.
  4. Timeout Settings: Cold starts for large models can be slow. The default timeoutMs has been increased; if timeouts occur, adjust it further based on actual conditions.
  • Plugin Directory: https://www.skillhub.cn/plugins/LouisCanBe/dsh-plugin-ollama-monitor
  • GitHub Repository: https://github.com/LouisCanBe/dsh-plugin-ollama-monitor