Skip to content

Fix Qwen3-VL normalization: use 0.5/0.5/0.5 from checkpoint#105

Merged
stikves merged 3 commits into
apple:mainfrom
stikves:fix/qwen3-vl-normalization
Jul 16, 2026
Merged

Fix Qwen3-VL normalization: use 0.5/0.5/0.5 from checkpoint#105
stikves merged 3 commits into
apple:mainfrom
stikves:fix/qwen3-vl-normalization

Conversation

@stikves

@stikves stikves commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

The qwen3-vl VLMSpec hardcoded OpenAI-CLIP normalization stats, but Qwen3-VL checkpoints specify image_mean=image_std=[0.5, 0.5, 0.5]. This caused a silent ~1.86x overscale on every pixel fed to the vision encoder.

Fixes #82.

Tested locally. Now it identifies background colors more correctly.

The qwen3-vl VLMSpec hardcoded OpenAI-CLIP normalization stats, but
Qwen3-VL checkpoints specify image_mean=image_std=[0.5, 0.5, 0.5].
This caused a silent ~1.86x overscale on every pixel fed to the
vision encoder.

Fixes apple#82.
@stikves
stikves merged commit ace0dc6 into apple:main Jul 16, 2026
3 checks passed
@stikves
stikves deleted the fix/qwen3-vl-normalization branch July 16, 2026 16:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

VLM: qwen3-vl exports CLIP normalization stats, but Qwen3-VL checkpoints specify image_mean = image_std = [0.5, 0.5, 0.5]

2 participants