Skip to content

@InferMatrixLab InferMatrixLab

All

    Repositories list

    12 repositories

    • InferMatrixCopilot

      Public
      Copilot of JiusiServe sub repos
      Python
      •8•17•7•19•Updated Oct 25, 2026Oct 25, 2026

    • awesome-model-hw-engines

      Public
      Curated list of model/hardware-specialized inference engines
      0•0•0•0•Updated Oct 25, 2026Oct 25, 2026

    • InferRSI

      Public
      Python
      •
      Apache License 2.0
      •8•47•33•24•Updated Oct 25, 2026Oct 25, 2026

    • system1-omni

      Public
      community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance
      Python
      •15•62•34•21•Updated Oct 25, 2026Oct 25, 2026

    • vllm-rlt

      Public
      A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages
      transformerinference-enginellm
      transformerinference-enginellm
      Python
      •
      Apache License 2.0
      •30•208•13•27•Updated Oct 24, 2026Oct 24, 2026

    • infermatrix.github.io

      Public
      InferMatrix brand website — Open to Infer. Built to Evolve.
      JavaScript
      •1•7•0•1•Updated Oct 24, 2026Oct 24, 2026

    • minicpm-o-4.5-single-gpu-engine

      Public
      Single-GPU streaming speech engine for MiniCPM-o 4.5 with a reproducible comparison against vLLM-Omni and SGLang-Omni
      Python
      •0•2•0•0•Updated Oct 23, 2026Oct 23, 2026

    • vllm-omni-mlx

      Public
      High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.
      ttsasrinference-engine
      ttsasrinference-enginediffusion-modelsvllmvllm-omniomni-modal
      Python
      •
      Apache License 2.0
      •4•26•20•9•Updated Oct 21, 2026Oct 21, 2026

    • qwen3-tts-rsi-npu-engine

      Public
      Fast qwen3-tts inference using RSI
      inferencettsrsi
      inferencettsrsi
      Python
      •
      Apache License 2.0
      •1•12•5•0•Updated Oct 21, 2026Oct 21, 2026

    • infermatrix-marketing

      Public
      Centralized marketing and community operations materials for InferMatrix projects.
      0•8•0•0•Updated Oct 20, 2026Oct 20, 2026

    • recipe

      Public
      Community maintained recipe of fast inference engine for indivdual model
      JavaScript
      •
      MIT License
      •0•8•1•0•Updated Oct 20, 2026Oct 20, 2026

    • drama-3-single-b300-engine

      Public
      Python
      •0•8•0•0•Updated Oct 16, 2026Oct 16, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.