Popular repositories Loading
-
-
-
llmperf
llmperf PublicForked from ray-project/llmperf
LLMPerf is a library for validating and benchmarking LLMs
-
threadstacks
threadstacks PublicForked from pixie-io/threadstacks
ThreadStacks can be used to inspect thread stacktraces of live C/C++ processes.
C++
-
tensorflow
tensorflow PublicForked from tensorflow/tensorflow
An Open Source Machine Learning Framework for Everyone
C++
-
mediapipe
mediapipe PublicForked from google-ai-edge/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
C++ 2
Repositories
- TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
- openvino Public Forked from openvinotoolkit/openvino
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
- llvm-project Public Forked from llvm/llvm-project
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
- iree Public Forked from iree-org/iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
- DeepSeek-Coder Public Forked from deepseek-ai/DeepSeek-Coder
DeepSeek Coder: Let the Code Write Itself
- mediapipe Public Forked from google-ai-edge/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
- vllm-multiturn-bench Public
Gimlet fork of vLLM benchmarks/multi_turn/ with auth-header and per-turn-aggregation patches. Cloned at Docker build time, mirrors gimletlabs/bench_serving pattern.
- torch-mlir Public Forked from llvm/torch-mlir
The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.
Top languages
Loading…
Most used topics
Loading…