Mistral batched decode: LLaMA decode path + parameterized RoPE theta (12x batched, full serving stack)#2

Open

mikepapadim wants to merge 1 commit into

feat/static-batched-decodefrom

feat/mistral-batched-decode

Commits on Jul 12, 2026

Add Mistral-7B batched decode: generalize decode layer graph to base Configuration + parameterize RoPE theta; full serving stack works (12x batched, coherent, prefix-consistent)
mikepapadim
committed