Official implementation of ARC-Decode, a training-free speculative decoding framework with risk-bounded acceptance. ICML 2026 Poster.
sampling large-language-models llm-inference speculative-decoding efficient-llm lossy-speculative-decoding eagle-3
-
Updated
Jul 3, 2026 - Python