#

llm-d

Here are 12 public repositories matching this topic...

llm-d / llm-d-deployer

Helm charts for llm-d

helm helm-chart llm-d

Updated Jul 22, 2025
Shell

llm-d-incubation / llm-d-fast-model-actuation

Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping

llm-d

Updated Apr 4, 2026
Go

aleskandro / llm-d-lab

Accelerate reproducible inference experiments for large language models with LLM-D! This lab automates the setup of a complete evaluation environment on OpenShift/OKD: GPU worker pools, core operators, observability, traffic control, and ready-to-run example workloads.

inference platform-engineering vllm llm-inference distributed-inference llm-d

Updated Apr 2, 2026
Python

redhat-na-ssa / demo-ocp-llm-d

Demo - Distributed Inference on OpenShift (aka llm-d)

openshfit vllm llm-d

Updated Mar 12, 2026
Python

whaili / llm-d

一个 Kubernetes 原生的高性能分布式大语言模型推理框架

llm-d

Updated Oct 31, 2025

whaili / llm-d-inference-sim

A light weight vLLM simulator, for mocking out replicas.

llm-d

Updated Oct 2, 2025
Go

maneeshsit / AI-Factory

Open Source software code for use with PCIe card-based hardware AI accelerators catering to both inference and training use cases

Updated Feb 21, 2026
Python

whaili / llm-d-benchmark

llm-d benchmark scripts and tooling

llm-d

Updated Oct 1, 2025
Jupyter Notebook

MarcoPalomo / rag-llm-d

RecursiveCharacterTextSplitter and context cache with llm-d

kubernetes rag helmfiles llm-d

Updated Jan 29, 2026
Python

whaili / llm-d-kv-cache-manager

Distributed KV cache coordinator

llm-d

Updated Oct 2, 2025
Go

whaili / llm-d-inference-scheduler

Inference scheduler for llm-d

llm-d

Updated Oct 2, 2025
Go

redhat-na-ssa / cnuland-ocp-llm-d

LLM-d on OCP

openshfit llm-d

Updated Oct 2, 2025
Shell

Improve this page

Add a description, image, and links to the llm-d topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-d topic, visit your repo's landing page and select "manage topics."