dsh-windtunnel: A Contract Regression Testbed for DSH Plugin Authors
dsh-windtunnel is a contract regression testing tool designed specifically for DeepSeek Harness (DSH) plugin authors, aiming to address pipeline integration issues that local unit tests struggle to expose. By utilizing a "Script Adapter Driven Real Pipeline" mechanism, the tool verifies plugin stability in a deterministic, isolated environment with zero API keys and zero network connectivity. It offers four levels of testing capabilities, ranging from L0 to L3, covering loading, contract verification, behavioral assertions, and exception injection, while supporting concurrent re-entry, event sequence checking, and negative case capture. The tool supports both CLI and Bundle usage modes, facilitating integration into CI pipelines or execution within DSH conversations. Its execution model emphasizes isolation, running the plugin under test in a network-disallowed subprocess to ensure a clean environment and reproducible results. It should be noted that this tool focuses on contract compliance rather than real mode.
Read More