dsh-windows-ocr: Providing Local Windows OCR Image Input for DSH Text Models
This article introduces the DSH plugin `maxwell-feng/dsh-windows-ocr`, designed to address the issue of text models being unable to directly process images. The plugin utilizes the Windows built-in `Windows.Media.Ocr` engine to locally recognize text within images and sends the recognized text rather than the original image bytes to the model, enabling pure text models to "understand" image content. Core features include default-only sending of OCR text for privacy protection, support for an optional `passthrough` mode for vision models to receive raw images, and a fail-closed mechanism that rejects image attachments when the plugin is not loaded. Before installation, ensure a Windows 10/11 environment and the corresponding language pack are in place, which can be quickly installed via npm commands or manually configured.
Read More