Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 85.2k 18.9k

2. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3.7k 576

3. awesome-ai-infra awesome-ai-infra Public

   106 7

4. microsoft/azure-linux-image-tools microsoft/azure-linux-image-tools Public

   Go 32 10

5. Sagemaker-DistilBERT Sagemaker-DistilBERT Public

   DistilBERT model fine-tuning with AWS Sagemaker.

   Jupyter Notebook 31 5

6. nano-vllm nano-vllm Public

   Forked from GeeeekExplorer/nano-vllm

   Nano vLLM

   Python 5 4