All

14 repositories

PUMA
Public
Aim to be a lightweight, high-performance inference engine for local AI.
rust inference-engine llm
rust inference-engine llm local-ai
Rust
•
Apache License 2.0
•1•1•3•0•Updated Apr 21, 2026Apr 21, 2026
alphatrion
Public
⚒️ The observability platform for agentic systems.
observability ai-applications ai-agent
observability ai-applications ai-agent llmops
Python
•
Apache License 2.0
•5•13•15•0•Updated Apr 21, 2026Apr 21, 2026
Awesome-LLMOps
Public
🎉 An awesome & curated list of best LLMOps tools.
awesome ai awesome-list
awesome ai awesome-list llm llmops ai-developer-tools
Python
•
Apache License 2.0
•54•220•5•18•Updated Apr 20, 2026Apr 20, 2026
website
Public
Website and Blogs.
blog website ai
blog website ai
HTML
•
MIT License
•1•1•1•0•Updated Apr 8, 2026Apr 8, 2026
llmaz
Public
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
kubernetes inference huggingface
kubernetes inference huggingface llm modelscope llamacpp vllm text-generation-inference ollama sglang
Go
•
Apache License 2.0
•47•301•39•13•Updated Jan 26, 2026Jan 26, 2026
.github
Public
Apache License 2.0
•1•0•0•0•Updated Jan 11, 2026Jan 11, 2026
AMRS
Public
🧬 The adaptive model routing system for exploration and exploitation.
sdk llm llmops
sdk llm llmops ai-gateway ai-proxy
Rust
•
MIT License
•6•24•2•0•Updated Jan 4, 2026Jan 4, 2026
omnistore
Public
🎯 An unified python client to communicate with various kinds of object-store providers.
python oss s3
python oss s3 gcs minio object-store
Python
•
MIT License
•3•3•3•0•Updated Nov 18, 2025Nov 18, 2025
template-repo
Public template
A template repo.
Apache License 2.0
•1•0•0•0•Updated Sep 19, 2025Sep 19, 2025
karpenter
Public
This is a fork of Karpenter focused on GPU scaling with llmaz.
Go
•
Apache License 2.0
•471•0•1•0•Updated Jun 18, 2025Jun 18, 2025
scheduler-plugins
Public
Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
Go
•
Apache License 2.0
•3•11•1•0•Updated Jun 16, 2025Jun 16, 2025
community
Public
The InftyAI community.
Apache License 2.0
•1•0•1•0•Updated Apr 18, 2025Apr 18, 2025
Manta
Public archive
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
kubernetes distributed-systems cache
kubernetes distributed-systems cache p2p-network llm
Go
•
Apache License 2.0
•3•26•14•1•Updated Dec 6, 2024Dec 6, 2024
PR-Copilot
Public archive
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
Python
•
MIT License
•3•3•2•0•Updated Jun 29, 2024Jun 29, 2024

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

InftyAI

All

All

14 repositories

PUMA

alphatrion

Awesome-LLMOps

website

llmaz

.github

AMRS

omnistore

template-repo

karpenter

scheduler-plugins

community

Manta

PR-Copilot

All

All

Repositories list

14 repositories