Skip to content

Add TornadoVM CUDA backend support and tensor-core (MMA) accelerated batch prefill (FP16 & Q8_0, Llama & Qwen3)#127

Open
mairooni wants to merge 19 commits into
mainfrom
feat/mma_cuda
Open

Add TornadoVM CUDA backend support and tensor-core (MMA) accelerated batch prefill (FP16 & Q8_0, Llama & Qwen3)#127
mairooni wants to merge 19 commits into
mainfrom
feat/mma_cuda

Commits

Commits on Jun 20, 2026

Commits on Jun 22, 2026

Commits on Jun 23, 2026

Commits on Jul 7, 2026