Introduction

In the DeepSeek Harness (DSH) Web UI, a single Q&A session often stays within the current context. After reading a technical explanation, if there is no immediate verification, the content can easily get mixed into the chat history, making it difficult to verify if it was truly understood later.

dsh-quiz addresses this problem: It targets the DSH Web UI, converting completed AI responses into single-choice, multiple-choice, or true/false questions, allowing users to answer immediately, view explanations, and decide whether to add them to a personal question bank or review list based on their preference.

What is it

dsh-quiz is a conversational question bank plugin for the DeepSeek Harness (DSH) Web UI, maintained by cungphammanh590-star, licensed under MIT.

It solves the problem: conversational AI responses are good for explaining concepts but lack a lightweight way to turn responses into verifiable materials. After using this plugin, users can create, answer, and view explanations for specific AI responses without leaving the current DSH Web session, and save questions of interest to a personal question bank.

Core Features

The following capabilities provided by dsh-quiz are introduced below:

  • Display a “Create Question” button below each completed AI response.
  • After clicking, questions are generated and displayed in a drawer on the right side; no messages are appended to the current conversation, and no new visible sessions are created.
  • You can continue the current topic during question generation; closing the drawer cancels any running generation requests.
  • Supports single-choice, multiple-choice, true/false, and mixed questions.
  • Select question quantity and difficulty.
  • Use native radio buttons and checkboxes for answering; submit for instant grading and display of explanations.
  • Questions are drafts by default; they are only added to the question bank after explicit user action.
  • “Add to Question Bank” and “Add to Review” are independent; they do not automatically schedule reviews.
  • Left sidebar question bank entry supports keyword search, “to review” filtering, and answer history statistics.
  • Each question retains the source session and answer excerpt, facilitating return to the knowledge context.
  • Question data is written to DSH domain storage; unsaved drafts will not occupy storage long-term.
  • The Web UI “Create Question” button directly uses the Host’s auxiliary model call for the plugin, without going through the conversation tool.
  • Provides model tools like quiz_create_draft, quiz_answer, quiz_save, quiz_list, etc., for natural language question creation, grading, saving, and querying.

Installation and Activation

The following conditions must be met before using the plugin:

  • DeepSeek Harness 0.1.x Web profile
  • Node.js ^22.19 or >=24
  • pnpm
  • Available model services configured in DSH

The current plugin version is built on DSH 0.1.0-rc.6 API. DSH is still in the pre-release phase. If you encounter compatibility issues after upgrading DSH, please reinstall the plugin and check the repository Issues first.

Recommended installation via GitHub. After entering any directory, run:

npx @deepseek-ai/dsh plugin --profile web add github:cungphammanh590-star/dsh-quiz
npx @deepseek-ai/dsh web

After installation, refresh the DSH Web page. The appearance of the “Question Bank” entry on the left and the “Create Question” button below AI responses indicates the plugin is enabled.

GitHub installation executes the repository’s prepare build script. pnpm version 10 and higher may block Git dependency builds by default; if installation fails for the first time, please follow the prompts in the terminal to add dsh-quiz to the allowBuilds section in the corresponding Web profile’s pnpm-workspace.yaml, then run the installation command again. You should only grant build permissions to plugin source code you trust.

Since the plugin runs with the permissions of the current dsh process, you should check the plugin source code, license, and build scripts before installation to ensure they meet your expectations.

Typical Usage

The button usage steps are as follows:

  1. Ask a question in DSH Web and wait for the AI to complete the response.
  2. Click “Create Question” below the response.
  3. Select the question type, quantity, and difficulty, then click “Start Creating Questions”; the right-side drawer opens immediately, and no new messages are added to the original conversation.
  4. You can continue the current conversation, or wait for the questions to be generated in the drawer, and then answer using radio buttons or checkboxes.
  5. View the grading results and explanations.
  6. If you need to keep it, check “Add to Review” and then click “Add to Question Bank”.
  7. Click “Question Bank” on the left to browse, search, or filter saved questions.

You can also call plugin capabilities directly through conversation, for example:

Based on the previous answer about JavaScript closures, give me two single-choice questions, don't show the answers yet.

Question 1: Select B. Add this question to the question bank, but don't add it to review for now.

Model Tools

The plugin provides the following model tools for users to call when explicitly requesting question creation, grading, saving, or querying in natural language:

  • quiz_create_draft: Creates 1–10 unsaved questions associated with the current DSH session.
  • quiz_answer: Grades based on option index and updates answer statistics.
  • quiz_save: Saves the specified draft and independently sets whether to add it to review.
  • quiz_list: Queries saved questions by topic or review status.

The Web UI “Create Question” button does not go through these conversation tools; it directly uses the Host’s auxiliary model call. Tools like quiz_create_draft are reserved for scenarios where users explicitly request question creation via natural language.

Data, Permissions, and Limitations

Data-related behaviors are as follows:

  • Saved questions use the DSH domain storage configured for the current Web profile.
  • Unsaved questions are in-process drafts with a quantity limit; they will be discarded after restarting DSH.
  • Questions record the AI response excerpts and source session ID used for generation.
  • Button-based question creation only sends the clicked response to the model router used by the current session, not the entire chat history.
  • Auxiliary question generation requests do not write to the chat message sequence and do not become part of subsequent conversation context.
  • The plugin itself does not provide external sync, telemetry, or an independent account system.
  • Generated content is still processed by the current DSH model provider, subject to its existing configuration and privacy policies.

Usage limitations are as follows:

  • Recorded review intentions exist, but spaced repetition or automatic review reminders are not yet implemented.
  • Question quality depends on the current model; reliability of questions and explanations should be checked before saving.
  • Saved questions do not currently support editing and version history.
  • The question bank currently follows a single DSH storage configuration and does not provide a cross-device sync interface.

The plugin bundle default configuration is as follows and can be overridden in the DSH profile patch:

maxDrafts: 50
maxQuestionsPerBatch: 10
maxSourceChars: 16000
maxGenerationTokens: 4096
generationTimeoutMs: 60000

generationTimeoutMs also constrains the model request; closing the question bank drawer will also actively cancel the current request.

Links

  • GitHub: https://github.com/cungphammanh590-star/dsh-quiz
  • Directory Page: If using the DeepSeek Harness plugin directory, search for dsh-quiz; this page does not provide a specific directory URL.