Skip to content

feat(model-config): detailed, concept-explaining flag tooltips#58

Open
AlienWalker1995 wants to merge 1 commit into
mainfrom
feat/model-flag-tooltip-detail
Open

feat(model-config): detailed, concept-explaining flag tooltips#58
AlienWalker1995 wants to merge 1 commit into
mainfrom
feat/model-flag-tooltip-detail

Conversation

@AlienWalker1995

Copy link
Copy Markdown
Owner

What

Expands each Model-tab flag tooltip from a one-liner into a short explanation of the underlying concept + the practical tradeoff, so the UI teaches the knob rather than just labeling it. ~266 chars avg (min ~197).

Examples:

  • rope_scaling — explains RoPE position encoding + native context length, then none/linear/yarn and when to use them.
  • kv quant / cache types — explains what the KV cache is and why it dominates long-context VRAM.
  • flash_attn, mmap (why off on Docker bind mounts), mtp (speculative decoding via the model's draft head), etc.

Where

Single source of truth — the HELP map in ops-controller/llamacpp_flags.py, served via GET /model-config descriptors. The dashboard already renders help as the tooltip, so no UI change.

Validated

27 schema tests green (incl. "every flag has help"), ruff clean. ops-controller rebuilt + recreated; /model-config serves the detailed text live (verified).

🤖 Generated with Claude Code

Expand each flag's HELP from a one-liner to a short explanation of the
underlying concept + the practical tradeoff — e.g. RoPE/YaRN context
extension, the KV cache and its quantization, Flash Attention, parallel
slots, mmap on bind mounts, and MTP speculative decoding. ~266 chars avg.

Served via GET /model-config descriptors; the dashboard already renders
`help` as a tooltip, so no UI change is needed.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant