dsh-quality-guard: Quality checking assistant responses with a second model
dsh-quality-guard is a DSH plugin suite maintained by wdj20050927 for workflow classification. It is currently at version 1.6.1 and licensed under the MIT License. It installs an `agent/turn-stopping` hook before the assistant's response is sent, passing the criteria, original question, and draft to an independent second model call. Each item is scored on a scale of 0-10 and converted to a 0-100 score; if any score falls below 6, the response is rejected directly. The number of rewrites is limited by `maxReworks`, and if the judge times out or encounters an error, it defaults to a "fail-open" policy to allow the response through. The `engine/` component provides the hooks, while `panel/` offers an optional Web quality control panel that reads and writes to `~/.dsh/quality-guard/settings.json`. The engine must be manually copied to the plugin directory and mounted in `cordis.patch.yml` using an absolute path, whereas the panel can be installed with the command `dsh plugin --profile web add`. Criteria can be defined in a text file or as a `criteria` array within the panel, and `dryRun` mode simulates the process before rejection. Note that audit logs record real conversation summaries to disk; you should read the source code thoroughly before installation.
Read More