#

production-inference

Here is 1 public repository matching this topic...

Mattral / FlashSpec

Adaptive speculative-decoding inference engine with Triton-optimised verification and online bandit draft selection.

machine-learning triton bandit-algorithms inference-optimization llm-inference speculative-decoding production-inference

Updated Jun 15, 2026
Python

Improve this page

Add a description, image, and links to the production-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the production-inference topic, visit your repo's landing page and select "manage topics."