Introduction

In the plugin ecosystem of DeepSeek Harness (DSH), connecting local resources is key to extending agent capabilities. When conversation content needs to interact with a device interface, manual operation is often inefficient. The dsh-ios plugin aims to solve this problem by directly integrating an iOS device or simulator into the conversational workflow, allowing the agent to control the device through natural-language instructions.

Plugin Overview

kickstartparty3459/dsh-ios is a DSH plugin designed to run a real-time iOS simulator in the conversation window or control a physical iPhone over a USB connection. It provides 22 dedicated agent tools and supports features such as MJPEG preview streaming, SwiftUI hot reloading, and on-screen text extraction.

Maintainer: Kickstartparty3459
License: MIT
Core Value: Zero-code iOS device control within DSH conversations.

Core Features

The plugin provides the following verified capabilities:

  • Device Control: Supports controlling a real-time iOS simulator and a physical iPhone connected over USB.
  • Agent Toolset: Includes 22 tools covering common device-interaction needs.
  • Vision and Interaction:
    • MJPEG Preview: Provides a real-time video-stream preview of the screen.
    • SwiftUI Hot Reloading: Supports immediate preview after code changes.
    • Tap and Type: Supports tapping screen elements and entering text.
    • Find Anything by Sight: Uses visual recognition to locate interface elements.
    • Read Text from Screen: Reads text content displayed on the screen.
    • Work with Lists: Handles scrolling and selection in list-based interfaces.
  • Control Panel: Provides a sidebar control panel to assist with operations.

Installation and Configuration

According to the project source code, this plugin currently does not provide a command-line installation command and is instead distributed through a desktop application. The installation process is as follows:

  1. Download the Application
    Visit https://kickstartparty3459.github.io, find the latest version, and download the installer.

  2. Install the Program
    Open the downloaded file and follow the on-screen prompts to complete the installation. The installation usually takes a short time.

  3. Launch
    After installation, launch the dsh-ios application from the desktop or Start menu.

  4. Connect a Device

    • Physical Device: Connect the iPhone to the computer using a USB cable and make sure the phone is unlocked.
    • Simulator: Click the “Simulator” button directly in the application to launch the built-in iOS simulator.

Usage Examples

In the DSH conversation window, you can control the device using natural-language commands. Verified typical commands include:

  • “Open the Settings app”
  • “Turn on Wi-Fi”
  • “Scroll down”
  • “Tap the login button”
  • “Take a screenshot”

Notes

  • Local Execution: The application runs on your local computer, data is stored only locally, and it is not uploaded to the cloud.
  • Physical Connection: A USB cable is required when operating a physical iPhone.
  • No Programming Skills Required: This tool is designed for no-code operation; it can be used with basic tapping and typing.
  • Simulator Support: Even without a physical iPhone, you can test using the built-in iOS simulator.

Conclusion

dsh-ios provides native iOS device-control capabilities for DeepSeek Harness, enabling agents to perform complex UI interaction tasks. For developers and testers who need automated testing, demo operations, or UI debugging, this is a practical tool.

Project Address: https://github.com/Kickstartparty3459/dsh-ios
Plugin Directory: https://www.skillhub.cn/plugins/Kickstartparty3459/dsh-ios