DSH-CoT-Profile: Real-Time Chain-of-Thought Trajectory Profiling Plugin for DeepSeek Harness

Preface

The plugin ecosystem of DSH allows for extending display, configuration, and recording capabilities during session runtime. For those who need to observe inference streams, reading raw reasoning text directly is not intuitive, and it also risks carrying original content into logs or transmission pipelines.

dsh-cot-profile addresses this issue: it provides real-time statistics on wording indicators, compares them against built-in profile baselines to determine which profile family the current session is closest to, and saves measurement records per session. It only exports aggregated results from host computation, without recording or transmitting raw reasoning text.

What This Is

Below is basic information about the plugin.

  • Plugin name: dsh-cot-profile
  • Maintainer: Chloride233
  • License: MIT
  • GitHub: https://github.com/Chloride233/dsh-cot-profile

One-sentence positioning: This is a real-time chain-of-thought trajectory profiling plugin for DeepSeek Harness, providing live wording indicators, profile-family judgment, and per-session measurement records.

Core Features

Real-Time UI

The plugin provides a session-header badge and a collapsible floating panel. Panel data is updated via session-projection push frames.

Indicators

The plugin tracks the following metrics:

  • let me count
  • we count
  • let's count
  • I count
  • first-line patterns
  • block-length median
  • interim visible replies

Judgment

Judgment performs weighted-distance matching against built-in profile baselines and provides a confidence score. When the trajectory falls within a transition band, the plugin reports it as uncertain rather than forcing a hard label.

Extensibility

Users can edit profile families and per-dimension weights via Web settings or cordis config.

Recording

Record mode saves per-turn cumulative JSON records. Records can be emitted as events or written to JSONL, for baseline calibration purposes.

Privacy

Only aggregates leave host computation; raw reasoning text is neither recorded nor transmitted.

Installation and Enablement

First, install the plugin. Use the installation command:

dsh plugin --profile web add github:Chloride233/dsh-cot-profile

After installation, you can enable and configure it as follows.

Web Settings Section

To see this plugin’s configuration section in Web settings while using DeepSeek Harness 0.1.0-rc.6, run the optional one-time patch:

sh scripts/install-patch.sh

This patch is optional and idempotent. Without it, configuration can still be done through cordis config.

Notes:

  • Running pnpm install in the profile directory will remove the copied packages; you will need to re-run the patch script afterward.
  • dsh upgrades may change the allowlist layout.

Local Path Installation

If installing via a local path, ensure the checkout has a resolvable node_modules directory and run the following within the checkout:

pnpm install

This issue does not occur when installing via a GitHub URL.

Typical Usage

First, configure; then, read events.

Configuration is located in the cot-profile plugin row, in either cordis.patch.yml or the current profile’s cordis.yml. Configurable items include:

minBlocksForJudgment
badge
panel
panelMode
weights
profiles
record.emit
record.file

Where:

  • badge and panel control the UI.
  • panelMode selects the panel mode; track is an experimental mode using direct DOM manipulation and may require adaptation after DSH upgrades.
  • weights adjusts per-dimension weights.
  • profiles adds user-editable profile families.
  • record.emit and record.file control record output.

Within the session scope, you can read the projection key:

useProjection('cot-profile')

Relevant events include:

cot-profile/update
cot-profile/record

Applicable Scenarios and Notes

Suitable for scenarios requiring the following capabilities:

  1. Real-time viewing of wording indicators in CoT sessions.
  2. Comparing against built-in baselines for profile-family judgment.
  3. Saving per-turn measurement records for baseline calibration.

Usage notes:

  1. The plugin runs with the permissions of the current dsh process; inspect the source code and MIT license before installation.
  2. The track mode in panelMode is experimental, using direct DOM manipulation, and may require adaptation after DSH upgrades.
  3. The Web settings section depends on a one-time patch for DeepSeek Harness 0.1.0-rc.6; without the patch, configuration can be done via cordis config.
  4. Local path installation requires a resolvable node_modules; installing via GitHub URL avoids this issue.

Conclusion

dsh-cot-profile transforms wording signals in inference streams into a real-time UI, profile judgment, and savable measurement records, while only outputting aggregated results without dispersing raw reasoning text.

GitHub: https://github.com/Chloride233/dsh-cot-profile

Directory page: No specific URL provided; you can search for dsh-cot-profile in the DSH community directory.

羽毛球分组比赛记分
小程序二维码

欢迎使用《羽毛球分组比赛记分》微信小程序

Xiaoye