llm-db

All

5 repositories

llmstation
Public
Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)
inference pytorch lora
inference pytorch lora fine-tuning peft llm co-serving
Python
•
Apache License 2.0
•5•8•0•0•Updated Apr 21, 2026Apr 21, 2026
MLKV
Public
MLKV: Efficiently Scaling up Large Embedding Model Training with Disk-based Key-Value Storage (ICDE 2025 Industry Track)
machine-learning recommender-system knowledge-graph-embeddings
machine-learning recommender-system knowledge-graph-embeddings graph-neural-networks key-value-storage
MIT License
•1•8•0•0•Updated Dec 15, 2025Dec 15, 2025
tensor-program-optimization-with-auto-batching
Public
Tensor Program Optimization with Auto-Batching (Master Thesis, ETH Zürich, 2025)
inference lora tvm
inference lora tvm peft llm
Python
•0•1•0•0•Updated Apr 8, 2025Apr 8, 2025
understanding-gpu-architecture-implications-on-llm-serving-workloads
Public
Understanding GPU Architecture Implications on LLM Serving Workloads (Master Thesis, ETH Zürich, 2024)
cuda inference pytorch
cuda inference pytorch transformer rocm
Python
•1•3•0•0•Updated Oct 24, 2024Oct 24, 2024
FineInfer
Public
Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
inference pytorch lora
inference pytorch lora fine-tuning peft llm co-serving
Python
•
MIT License
•2•19•0•0•Updated May 28, 2024May 28, 2024

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.