Popular repositories Loading

1. bm-infra bm-infra Public

   Forked from QiliangCui/bm-infra

   vLLM TPU Benchmark infra

   Python

2. tpu-inference tpu-inference Public

   Forked from vllm-project/tpu-inference

   TPU inference for vLLM, with unified JAX and PyTorch support.

   Python

3. jax jax Public

   Forked from jax-ml/jax

   Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python