dsh_omnivision: An OmniParser-Driven GUI Agent Plugin

OmniVision is a GUI agent plugin built on OmniParser, designed to address the challenge that models without native multimodal vision capabilities have difficulty understanding screens and operating interfaces. The plugin converts screen content into structured data containing text, icons, and coordinates, supporting screen recognition, desktop automation (clicking, typing, etc.), real-time Dock recognition, image parsing, and tool call logging. Installation requires conditions such as a Windows platform and a running OmniParser service, and it is primarily targeted at desktop task development scenarios for DeepSeek Harness.

Read More