Rust-native MoE inference runtime with custom CUDA kernels for Blackwell GPUs. Includes DFlash speculative decoding, multi-tier Engram memory, and entropy-adaptive routing. Targets Qwen3.5-35B-A3B on a single RTX 5060 Ti 16GB.

llama.cpp fork with additional SOTA quants and improved performance

Runs a Rust inference server for hybrid State-Space and MoE language models with fast GPU throughput on consumer hardware