Gemma 4 on the batched-decode branch: merge #120 + perf findings (CUDA graphs +13.6%)#1
Open
mikepapadim wants to merge 18 commits into
Open
Gemma 4 on the batched-decode branch: merge #120 + perf findings (CUDA graphs +13.6%)#1mikepapadim wants to merge 18 commits into
mikepapadim wants to merge 18 commits into
Commits
Commits on Jun 7, 2026
Commits on Jun 25, 2026
Commits on Jun 26, 2026
Commits on Jul 11, 2026
- committed
- committed
- committed
- committed
Gemma4 batched decode (2/N): NEOX RoPE (own-KV + Q-only) + per-head Q/K/V RMSNorm kernels, validated
committed- committed
- committed
Commits on Jul 12, 2026
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed