Skip to content

[Depend on nntrainer @3897] [TurboQuant] Apply TurboQuant 4-bit KV cache to MHACoreLayer#8

Open
EunjuYang wants to merge 4 commits into
nntrainer:mainfrom
EunjuYang:feat/turboquant-kvcache
Open

[Depend on nntrainer @3897] [TurboQuant] Apply TurboQuant 4-bit KV cache to MHACoreLayer#8
EunjuYang wants to merge 4 commits into
nntrainer:mainfrom
EunjuYang:feat/turboquant-kvcache

[TurboQuant] Restore cache_index-based KV positioning in mha_core

e55f2d1
Select commit
Loading
Failed to load commit list.