dsh-vision-android:DeepSeek Harness 视觉理解与 Android UI 自动化插件

dsh-vision-android 是一款基于 DeepSeek Harness 的插件,旨在为智能体提供多模态视觉理解与 Android UI 自动化能力。该插件集成 11 个工具,主要解决两大需求:一是将本地截图或图片发送给视觉模型进行分析;二是通过 ADB 在 Android 设备上执行真实的点击、滑动、输入及按键操作。 核心功能分为视觉理解(如 `vision_ask`、`mobile_look`、截屏等)和 UI 自动化(如 `mobile_tap`、`mobile_swipe`、文本输入、APK 安装、应用启动等)。使用时,智能体可形成“截图分析 → 定位元素 → 执行操作 →

Read More
DSH-LLM-Vision-Bridge: Integrating Image Understanding into DeepSeek Text Models in the DSH Web GUI

dsh-llm-vision-bridge is a DSH plugin licensed under MIT, designed to address the issue of text models being unable to directly process images. This plugin registers the `deepseek-vision` provider in DSH's `LlmAdapter`. When a request includes images, it automatically routes them to a configured vision model (such as pi-ai or a local llama.cpp) to generate text descriptions, which are then used by the DeepSeek text model to continue the conversation based on the descriptions. If no images are present, the request is directly passed through to a fallback provider for zero-overhead operation. Key features include an LRU cache to avoid duplicate descriptions, automatic retries for 503/429 errors and timeouts, and configurable failure policies (placeholder or error). After installation, the web service must be restarted, and configuration is required in the settings.

Read More