Popular repositories Loading

1. kubernetes kubernetes Public

   Forked from kubernetes/kubernetes

   Production-Grade Container Scheduling and Management

   Go

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. llm-instance-gateway llm-instance-gateway Public

   Forked from kubernetes-sigs/gateway-api-inference-extension

   LLM Instance gateway implementation.

   Go 1

4. ai-on-gke ai-on-gke Public

   Forked from GoogleCloudPlatform/ai-on-gke

   AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kubernetes Engine

   Jupyter Notebook

5. vllm-v1-lora vllm-v1-lora Public

   Python

6. inference-benchmark inference-benchmark Public

   Forked from AI-Hypercomputer/inference-benchmark

   Python