Skip to content

Mistral batched decode: LLaMA decode path + parameterized RoPE theta (12x batched, full serving stack)#2

Open
mikepapadim wants to merge 1 commit into
feat/static-batched-decodefrom
feat/mistral-batched-decode
Open

Mistral batched decode: LLaMA decode path + parameterized RoPE theta (12x batched, full serving stack)#2
mikepapadim wants to merge 1 commit into
feat/static-batched-decodefrom
feat/mistral-batched-decode

Add Mistral-7B batched decode: generalize decode layer graph to base …

c185336
Select commit
Loading
Failed to load commit list.

There are no checks for this commit