dsh-llm-verifier: Verification, Ranking, and Controlled Application of Multi-candidate Patches

dsh-llm-verifier is a DeepSeek Harness plugin maintained by Web0926 that solidifies the workflow of "generating multiple candidate patches → test filtering → LLM ranking → manual approval and application". It runs 3 or 5 candidates for the same coding task, each working in an independent detached Git worktree. It first executes deterministic verification to eliminate failed candidates, then uses llm-verifier to rank them. If only one passes, it is selected directly; with 2 candidates, it uses a pivot; and with 3 to 5 candidates, it uses two pivots. The plugin imposes two approval gates: one before candidate execution and one before applying the patch. Before application, it verifies the repository path, base HEAD, clean status, and the patch's SHA-256. Verification commands can be automatically detected or explicitly specified and support npm/pnpm.

Read More