dsh-batch-regression: Run the same command N times, use the median instead of a single result to draw conclusions.

# Introduction Most developers who have done performance tuning have encountered this situation: running a benchmark once yields 1200ms, while rerunning it at a different time yields 1900ms. You change a line of code to verify if it's faster; one run feels faster, but another run feels like an illusion. Single results are subject to environmental noise, so drawing conclusions directly from them is unreliable. The philosophy of DSH (DeepSeek Harness) is "everything is a plugin," and this problem has a corresponding plugin to solve it. Below, I introduce `dsh-batch-regression`, maintained by PangYiMing: it runs the same command N times, takes the median and distribution, and uses statistical analysis rather than single results to draw conclusions. # What is this? `dsh-batch-regression` is a DeepSeek Harness (DSH) plugin, positioned to...

Read More