Skip to content

Add TornadoVM CUDA backend support and tensor-core (MMA) accelerated batch prefill (FP16 & Q8_0, Llama & Qwen3)#127

Open
mairooni wants to merge 19 commits into
mainfrom
feat/mma_cuda
Open

Add TornadoVM CUDA backend support and tensor-core (MMA) accelerated batch prefill (FP16 & Q8_0, Llama & Qwen3)#127
mairooni wants to merge 19 commits into
mainfrom
feat/mma_cuda

Merge remote-tracking branch 'origin/main' into feat/mma_cuda

03c2362
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar