[Huginn] Opt-in prefix caching with position-keyed recurrent-state noise (stacked on #147) - #152

[Huginn] Opt-in prefix caching with position-keyed recurrent-state noise (stacked on #147)#152

0z5a wants to merge 2 commits into

InferMatrixLab:mainInferMatrixLab/vllm-rlt:mainfrom

0z5a:huginn/prefix-cache-position-noise0z5a/vllm-rlt:huginn/prefix-cache-position-noiseCopy head branch name to clipboard