dsh-llm-proxy: Routing dsh's LLM Requests Through a Configurable HTTP Proxy

dsh-llm-proxy is a global HTTP proxy plugin for DeepSeek Harness (dsh), designed to route LLM requests issued by dsh to a specified proxy. It leverages undici's setGlobalDispatcher and EnvHttpProxyAgent to take over request routing, supporting immediate effect upon configuration changes (hot switching) without requiring a process restart. The plugin is also recoverable, automatically restoring the baseline dispatcher when disabled to avoid residue. Users can configure the enable status, proxy address, and exclusion list via the dsh settings page or by editing the settings.yaml file. Additionally, the plugin provides a local interface accessible only via loopback, used to view the current proxy status and test connectivity from the proxy to the target endpoint. When installing, the specified [installation instructions] must be followed.

Read More