dsh-web-fetch-moli

In the DeepSeek Harness ecosystem, web-fetch tools typically rely on Chromium or Playwright for JavaScript rendering, with each instance consuming 800 MB to over 1.2 GB of RAM. On resource-constrained servers that must simultaneously drive enterprise micro-frontend sandboxes (Alibaba Alfa, qiankun, single-spa), infinite-scroll sentinels, or dynamic SPAs, that footprint simply does not scale. dsh-web-fetch-moli swaps the rendering backend to Moli, an ultra-lightweight Rust headless browser, bringing per-instance memory down to 50-60 MB-a reduction exceeding 90%-so high-concurrency fetching remains viable on ordinary VPS hardware.

The plugin centers on full rendering fidelity at minimal cost. CDP Micro-Clip layout materialization combined with Page.setBypassCSP cleanly renders complex micro-frontends and dynamic style-loaders with zero user-script monkey-patching. A two-stage denoise pipeline first strips ads, navigation bars, footers, and forms via LinkeDOM and Mozilla Readability, then converts the result through mdream-a native Rust converter with a pure-JS fallback-into LLM-optimized GitHub Flavored Markdown, with inline base64 images automatically collapsed into compact size placeholders. A built-in Cloudflare challenge handler waits naturally within the same page context for verification to clear, avoiding artificial bot behaviors. On first use, if no Moli binary is detected, the plugin automatically downloads and caches the correct release for your OS and architecture, eliminating manual setup entirely.

This solution is well suited for DSH users running high-concurrency web rendering on constrained hardware, developers who need reliable parsing of dynamic micro-frontends and SPAs without Chromium-level memory overhead, and pipeline teams that feed fetched content directly into large language models and demand clean, structured Markdown output. Two flexible backends let you toggle between a locally managed Moli daemon and a remote CDP endpoint, adapting seamlessly between single-node and browser-cluster deployments.