Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 85.2k 18.9k

2. IBM/text-generation-inference IBM/text-generation-inference Public

   IBM development fork of https://github.com/huggingface/text-generation-inference

   Python 65 35

3. kserve/modelmesh kserve/modelmesh Public archive

   Distributed Model Serving Framework

   Java 190 80

4. netty/netty netty/netty Public

   Netty project - an event-driven asynchronous network application framework

   Java 35k 16.3k

5. IBM/kv-utils IBM/kv-utils Public

   Abstracted helper classes providing consistent key-value store functionality, with zookeeper and etcd3 implementations

   Java 6 3