dsh-qwen-mm: Adding Multimodal Reading and Tool Integration to DeepSeek Harness
dsh-qwen-mm is a DeepSeek Harness (DSH) plugin maintained by RRRosmontis, designed to enable text-only models to process multimodal content such as images, videos, and documents via MCP tools. This plugin integrates the capabilities of Qwen-MM-Plugins, offering features like multimodal reading, cloud-based vision/OCR/ASR, web search, video processing, and 3D/CAD toolchains. Its core functions include basic reading without a key, an advanced API requiring a DashScope key, a retrieval function requiring keys from search service providers, and support for long-video Q&A as well as tools like Blender and FreeCAD. A standout feature, "Drag-and-Drop Image Upload," allows users to drag images into the input box for the model to read; however, this feature relies on core changes to DSH that have not yet been merged into the official version and requires the use of a specific fork.
Read More