dsh-mlx-local: Running Local Large Models on Apple Silicon Macs
`dsh-mlx-local` is a DeepSeek Harness plugin designed specifically for Apple Silicon Macs to simplify local model inference. It automatically manages Python environments, virtual environments, and the `mlx_lm.server` service, seamlessly integrating local inference into DSH’s custom provider system. Core features include model directory management, automatic environment setup, service start/stop control, and thinking-intensity optimization for Qwen3. The plugin does not register additional providers or tools and runs purely as infrastructure. Users must manually start the service and configure the Provider in settings to connect to the local API. It supports macOS 13 and later.
Read More