dsh-model-failover: A Two-Level Circuit Breaker and Failover Plugin for DeepSeek Harness
dsh-model-failover is a model-level fault tolerance plugin for DeepSeek Harness (DSH). It automatically switches to fallback routes when failures occur using a two-level circuit-breaking strategy (model-level and platform-level), ensuring service continuity. The plugin supports failover and recovery probing, and works in coordination with llm-retry. To configure it, specify fallbacks in cordis.patch.yml, and be mindful of context window compatibility and process-local state limitations.
Read More