@dsh-extension/dsh-vision-bridge: On-Demand Visual Capability Integration for Text-Only DSH Sessions

`@dsh-extension/dsh-vision-bridge` is a third-party plugin that provides on-demand visual capabilities for text-only DSH sessions. It addresses the issues where text models cannot process image blocks and sending long history directly to vision models is prohibitively expensive. Mechanically, the plugin preserves the original images in the session and UI, only reformatting the images into text tokens at the text model's input layer. When the model needs to understand an image, it invokes the `vision_describe` tool, sending only the specified images (1-4) and a focused question to an OpenAI-compatible vision endpoint, thereby avoiding the transmission of lengthy session histories. The plugin supports installation via npm, with configuration options including enable status, base URL, API key (with environment variable support), and vision model name. Configuration priority follows the order: settings.

Read More