Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3.7k 576

2. project-codeflare/codeflare project-codeflare/codeflare Public

   Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.

   Jupyter Notebook 236 37

3. llm-d/llm-d-router llm-d/llm-d-router Public

   llm-d Router: The intelligent entry point for inference requests

   Go 241 260

4. llm-d/llm-d-benchmark llm-d/llm-d-benchmark Public

   llm-d benchmark scripts and tooling

   Python 62 101

5. foundation-model-stack/multi-nic-cni foundation-model-stack/multi-nic-cni Public

   Go 40 11