We're excited to have a strong vLLM presence at #PyTorchCon North America this year.
🔷 @simon_mo_ , vLLM core maintainer and Co-founder / CEO of @inferact, will give the keynote on scaling open frontier inference infrastructure
🔷 vLLM core maintainer @nickhill33 and George
vLLM (@vllm_project) is a high-throughput, memory-efficient inference and serving engine for LLMs. At #PyTorchCon North America, you’ll find vLLM-related work throughout the program, from Simon Mo’s keynote to technical sessions and posters covering LLM inference and serving.
