Gemma 4 on the batched-decode branch: merge #120 + perf findings (CUDA graphs +13.6%)#1
Open
mikepapadim wants to merge 18 commits into
Open
Gemma 4 on the batched-decode branch: merge #120 + perf findings (CUDA graphs +13.6%)#1mikepapadim wants to merge 18 commits into
mikepapadim wants to merge 18 commits into