Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 85.2k 18.9k

2. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3.7k 576

3. flame/blis flame/blis Public

   BLAS-like Library Instantiation Software Framework

   C 2.7k 423