Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3.7k 576

2. llm-d/llm-d-kv-cache llm-d/llm-d-kv-cache Public

   Distributed KV cache scheduling & offloading libraries

   Go 159 145

3. llm-d/llm-d-router llm-d/llm-d-router Public

   llm-d Router: The intelligent entry point for inference requests

   Go 241 260

4. kubestellar/kubestellar kubestellar/kubestellar Public

   KubeStellar - a flexible solution for multi-cluster configuration management for edge, multi-cloud, and hybrid cloud

   Go 692 302