Skip to content

@InftyAI InftyAI

Change the repository type filter

All

    Repositories list

    14 repositories

    • Awesome-LLMOps

      Public
      🎉 An awesome & curated list of best LLMOps tools.
      awesomeaiawesome-list
      awesomeaiawesome-listllmllmopsai-developer-tools
      Python
      •
      Apache License 2.0
      •55•223•5•17•Updated Apr 24, 2026Apr 24, 2026

    • PUMA

      Public
      Aim to be a lightweight, high-performance inference engine for local AI.
      rustinference-enginellm
      rustinference-enginellmlocal-ai
      Rust
      •
      Apache License 2.0
      •1•1•3•0•Updated Apr 24, 2026Apr 24, 2026

    • alphatrion

      Public
      ⚒️ The observability platform for agentic systems.
      observabilityai-applicationsai-agent
      observabilityai-applicationsai-agentllmops
      Python
      •
      Apache License 2.0
      •5•13•15•0•Updated Apr 21, 2026Apr 21, 2026

    • website

      Public
      Website and Blogs.
      blogwebsiteai
      blogwebsiteai
      HTML
      •
      MIT License
      •1•1•1•0•Updated Apr 8, 2026Apr 8, 2026

    • llmaz

      Public
      ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
      kubernetesinferencehuggingface
      kubernetesinferencehuggingfacellmmodelscopellamacppvllmtext-generation-inferenceollamasglang
      Go
      •
      Apache License 2.0
      •47•301•39•13•Updated Jan 26, 2026Jan 26, 2026

    • .github

      Public
      Apache License 2.0
      •1•0•0•0•Updated Jan 11, 2026Jan 11, 2026

    • AMRS

      Public
      🧬 The adaptive model routing system for exploration and exploitation.
      sdkllmllmops
      sdkllmllmopsai-gatewayai-proxy
      Rust
      •
      MIT License
      •6•24•2•0•Updated Jan 4, 2026Jan 4, 2026

    • omnistore

      Public
      🎯 An unified python client to communicate with various kinds of object-store providers.
      pythonosss3
      pythonosss3gcsminioobject-store
      Python
      •
      MIT License
      •3•3•3•0•Updated Nov 18, 2025Nov 18, 2025

    • template-repo

      Public template
      A template repo.
      Apache License 2.0
      •1•0•0•0•Updated Sep 19, 2025Sep 19, 2025

    • karpenter

      Public
      This is a fork of Karpenter focused on GPU scaling with llmaz.
      Go
      •
      Apache License 2.0
      •472•0•1•0•Updated Jun 18, 2025Jun 18, 2025

    • scheduler-plugins

      Public
      Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
      Go
      •
      Apache License 2.0
      •3•11•1•0•Updated Jun 16, 2025Jun 16, 2025

    • community

      Public
      The InftyAI community.
      Apache License 2.0
      •1•0•1•0•Updated Apr 18, 2025Apr 18, 2025

    • Manta

      Public archive
      💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
      kubernetesdistributed-systemscache
      kubernetesdistributed-systemscachep2p-networkllm
      Go
      •
      Apache License 2.0
      •3•26•14•1•Updated Dec 6, 2024Dec 6, 2024

    • PR-Copilot

      Public archive
      Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
      Python
      •
      MIT License
      •3•3•2•0•Updated Jun 29, 2024Jun 29, 2024
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.