DeepSeek Harness Plugin: LLM Call Rate Limiter
`dsh-llm-rate-limiter` is a plugin for DeepSeek Harness that mitigates API rate limiting or excessive resource consumption when calling LLM interfaces. It allows independent per-model configuration of concurrency, RPM, and burst traffic limits, provides token bucket and sliding window rate-limiting algorithms, and supports queueing or rejection policies. It includes an interactive GUI configuration panel, real-time status monitoring, and hot reloading, enabling policy adjustments without editing files. It is suitable for developers who need fine-grained control over LLM call frequency in DSH environments.
Read More