Pinned Loading

1. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 119k 20.2k

2. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Python 5.9k 1.1k

3. FlashAttention FlashAttention Public

   Python 2 1

4. cuda-gemm cuda-gemm Public

   Cuda 2