dsh-llm-auto-route: Auto Routing and Failover Plugin for DeepSeek Harness

`dsh-llm-auto-route` is a community-maintained Cordis plugin designed to simplify the management of multiple LLM inference providers in DeepSeek Harness. It addresses the complexity of manually switching providers by automatically discovering and matching providers, performing health checks, and enabling failover before output. It supports YAML configuration overrides and offers multiple matching priorities, including explicit specification, environment variables, base URLs, and model prefixes. It can also perform intelligent routing based on health check results. After installation, it requires loading the official adapter and is suitable for agent development scenarios that demand high availability and automated provider management.

Read More