Skip to content
Change the repository type filter

All

    Repositories list

    • Python
      MIT License
      3321Updated Apr 25, 2026Apr 25, 2026
    • Benchmarking different llm models from various cloud service providers
      Python
      13117Updated Apr 25, 2026Apr 25, 2026
    • Kubernetes-based, scale-to-zero, request-driven compute
      Go
      Apache License 2.0
      1.2k000Updated Apr 23, 2026Apr 23, 2026
    • A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      16k000Updated Apr 23, 2026Apr 23, 2026
    • rdma-demo

      Public
      Go
      0000Updated Mar 31, 2026Mar 31, 2026
    • A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      16k000Updated Mar 23, 2026Mar 23, 2026
    • AWS SDK for the Go programming language.
      Go
      Apache License 2.0
      775000Updated Mar 21, 2026Mar 21, 2026
    • verl

      Public
      verl: Volcano Engine Reinforcement Learning for LLMs
      Python
      Apache License 2.0
      3.8k000Updated Feb 26, 2026Feb 26, 2026
    • A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      16k000Updated Sep 19, 2025Sep 19, 2025
    • slimsc

      Public
      Official repository for the EMNLP 2025 paper "Slim-SC: Thought Pruning for Efficient Scaling with Self-Consistency".
      Jupyter Notebook
      MIT License
      01400Updated Sep 18, 2025Sep 18, 2025
    • Scripts and docs for self-hosting infrastructure for hackathon
      Shell
      0000Updated Feb 14, 2025Feb 14, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.