vision-use
Run the following command in DeepSeek Harness:
dsh plugin install zzy6-a/vision-use
Paste the following prompt into your AI chat to install this plugin:
In the DeepSeek Harness terminal, run dsh plugin install zzy6-a/vision-use to install the plugin. Source: https://github.com/zzy6-a/vision-use . Restart DSH after installation to activate all tools.
About this plugin
Agents inside DeepSeek Harness have long been trapped in a text-only world: they cannot see the screen, move the mouse, or type into an application, so any desktop-level task such as browsing, filling forms, or writing in Notepad simply cannot be completed end-to-end. vision-use plugs that gap by piping full-screen captures straight into the model's visual channel (real image tokens, not OCR) and handing the agent a full set of desktop tools: smooth cursor glide, left-right-double click, per-key VK injection with zero clipboard writes (Chinese characters go through the IME), and combination-key shortcuts. The result is a genuine see-act-verify loop.
Every hands action force-raises a Codex-style blue glow overlay first, so there is no silent operation. Pressing Esc immediately sets a cancel flag, dismisses the overlay, and rejects all subsequent motion. A task-level keep-alive keeps the overlay visible while the agent is still thinking or calling other tools, then auto-dismisses it about four seconds after the turn ends, with an idle-timer safety net as a backstop.
Designed for users running DeepSeek Harness on Windows native or WSL2 who want the model to independently close out full desktop tasks. The plugin makes zero network requests of its own, has zero runtime dependencies (pure ESM plus a PowerShell child process), and always routes the screenshot to whichever model you have selected-it never picks or alters the routing, keeping privacy fully under your control.
Use Cases
- Let the agent screenshot the browser and navigate to a target URL
- Open Notepad, type a document character by character, then verify via screenshot
- Drive Windows-side applications from WSL2 to fill and submit forms
Best For
- Developers running DeepSeek Harness on Windows native or WSL2
- Builders who want a full see-act-verify desktop loop
- Automation engineers who need desktop control without relying on OCR
Related Plugins
A method pack that makes AI coding agents plan against your real baseline, prove completion with fresh evidence, and reduce reworks and unsafe changes.
Turns the DeepSeek Harness session into a captain that builds a durable sub-agent team, splits goals into dependency-aware tasks, and coordinates work via direct messages and a live Web UI.
Gives coding agents design judgment, letting Claude Code, Cursor, and 70+ agents generate and iterate high-quality UI, presentations, and graphics right from the terminal.
Run the Pi ecosystem's plugins on DeepSeek Harness, unmodified, via a compatibility layer that implements Pi's public extension ABI on DSH's native services.