Efficient Triton Kernels for LLM Training
-
Updated
Apr 18, 2026 - Python
#
triton-kernels
Here are 22 public repositories matching this topic...
FlagGems is an operator library for large language models implemented in the Triton Language.
-
Updated
Apr 22, 2026 - Python
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
-
Updated
Apr 16, 2026 - Python
A light llama-like llm inference framework based on the triton kernel.
-
Updated
Jan 5, 2026 - Python
Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
-
Updated
Mar 27, 2026 - Jupyter Notebook
Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
retrieval encoder inference embeddings ner serving rag colbert ml-infra-deployments vllm gliner multimodal-rag ai-infrastructure colpali triton-kernels vllm-plugins
-
Updated
Apr 21, 2026 - Python
A "standard library" of Triton kernels.
-
Updated
Oct 2, 2025 - Python
Manifold-Constrained Hyper-Connections with fused Triton kernels for efficient training
-
Updated
Mar 10, 2026 - Python
Educational resource demonstrating common GPU programming pitfalls and solutions using Triton kernels.
-
Updated
Feb 26, 2026 - Jupyter Notebook
High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.
semantic-search-engine on-premise colbert-ai multivector quantizations retrieval-augmented-generation vector-databases rag-pipeline multimodal-rag colpali triton-kernels late-interaction multivector-search multivector-embeddings
-
Updated
Apr 21, 2026 - Python
Universal AI Runtime — Execute any model on any hardware
-
Updated
Apr 20, 2026 - Python
Official Code for the paper ELMO : Efficiency via Low-precision and Peak Memory Optimization in Large Output Spaces (in ICML 2025)
chunking multi-label-classification extreme-classification low-precision-training large-output-space float8 triton-kernels gradient-fusion
-
Updated
Feb 27, 2026 - Python
KernelHeim – development ground of custom Triton and CUDA kernel functions designed to optimize and accelerate machine learning workloads on NVIDIA GPUs. Inspired by the mythical stronghold of the gods, KernelHeim is a forge where high-performance kernels are crafted to unlock the full potential of the hardware.
-
Updated
Apr 15, 2026 - Python
🚀 Learn GPU Programming by Implementing FlashAttention from Scratch | 从零实现 FlashAttention，掌握 Triton GPU 编程
python tutorial deep-learning cuda pytorch triton educational attention cuda-kernels attention-mechanism gpu-programming gpu-optimization memory-optimization kernel-development llm flash-attention h100 triton-kernels flashattention online-softmax
-
Updated
Apr 21, 2026 - Python
A container of various PyTorch neural network modules written in Triton.
-
Updated
Mar 31, 2026 - Python
💥 Optimize linear attention models with efficient Triton-based implementations in PyTorch, compatible across NVIDIA, AMD, and Intel platforms.
reinforcement-learning computer-vision deep-learning transformers pytorch rnn attention language-model flame machine-learning-systems sequence-modeling fast-weight-programmers large-language-models llm triton-lang xlstm triton-kernels key-value-memory
-
Updated
Apr 22, 2026 - Python
FlashAttention2 Analysis in Triton
-
Updated
Oct 24, 2025 - Python
Collection of Triton operators for transformer models.
pytorch transformer triton attention normalization gpu-optimization pytorch-implementation triton-kernels pytorch-optimization
-
Updated
Jun 25, 2025 - Python
Repository for learning Triton GPU programming
-
Updated
Oct 24, 2025 - Python
High-performance Triton kernel library for LLM training with 12 fused operators (AttnRes, RMSNorm, RoPE, CrossEntropy, GRPO, JSD, FusedLinear, etc.) — up to 24x faster than PyTorch with 78% memory savings, outperforming Liger-Kernel on RTX 5090
-
Updated
Mar 21, 2026 - Python
Improve this page
Add a description, image, and links to the triton-kernels topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the triton-kernels topic, visit your repo's landing page and select "manage topics."