dsh-gesture-mouse

Wrist fatigue from hours of mouse use is real. dsh-gesture-mouse turns the macOS built-in camera into a touchless gesture input: point your index finger to move the cursor, pinch thumb and index to click or press-drag, swipe index and middle finger to scroll, and open your palm wide to freeze everything and trigger a local panic stop. The entire real-time pipeline—vision recognition, filtering, state machine, CoreGraphics mouse event synthesis—runs on the Mac itself. No LLM is involved. IPC carries only gestureId, confidence, and timestamps; frames and joint points never leave memory, are never uploaded, and are never saved. Low latency, zero privacy leakage, no cloud inference dependency.

The plugin deliberately separates "does it work" from "is it polished." The V0 baseline ships a full DSH toolset (gesture_status / start / stop / test_trigger), mandatory cooldowns and deduplication, per-minute rate caps, authenticated IPC lifecycle management, and a set of auditable safety floors that no config file can weaken. All special gestures are disabled by default and must be individually opted into. Vision confidence still degrades under low light, occlusion, or unusual hand shapes, so it is best treated as a supplementary channel alongside your primary mouse rather than a sole input device.

If you already run the DeepSeek Harness CLI, are curious about camera-based gesture interaction, and want the whole process to be auditable, reversible, and free of screen-recording permissions, this is a community project worth trying and helping to calibrate. It is aimed at macOS 13+ users who enjoy the "reach and operate" experience and are willing to spend a few minutes tuning sensitivity and minimumConfidence on their own hardware.