InferMatrixLab

Popular repositories Loading

1. vllm-rlt vllm-rlt Public

   A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages

   Python 208 30

2. system1-omni system1-omni Public

   community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance

   Python 62 15

3. InferRSI InferRSI Public

   Python 47 8

4. vllm-omni-mlx vllm-omni-mlx Public

   High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.

   Python 26 4

5. InferMatrixCopilot InferMatrixCopilot Public

   Copilot of JiusiServe sub repos

   Python 17 8

6. qwen3-tts-rsi-npu-engine qwen3-tts-rsi-npu-engine Public

   Fast qwen3-tts inference using RSI

   Python 12 1