Commits

History for

Commits on Jul 1, 2026

update documentation for llm-d well lit path and remove the old llm-d quickstart guide (#473)
gushob21
authored

Commits on Jun 23, 2026

Commits on Jun 22, 2026

Adding reference architectures for optimized-baseline, precise prefix cache routing, predicted latency routing llm-d well-lit paths (#461)

gushob21
and
syeda-anjum
authored

Commits on Jun 3, 2026

Commits on May 22, 2026

fix: Gemma 4 Inference-perf Updates (#431)
syeda-anjum
authored

Commits on May 14, 2026

feat: gemma-4 templates for GPUs and TPUs (#417)
syeda-anjum
authored

Commits on Mar 31, 2026

Commits on Mar 23, 2026

llmd reference architecture (#385)
gushob21
authored

Commits on Mar 17, 2026

readme updates (#389)
damadei-g
authored

Commits on Mar 11, 2026

Add offline batch reference implementation (#358)
laurentgrangeau
authored

Commits on Feb 17, 2026

Typo fix for gpt-oss-20b model in vllm-with-hf-model.md (#372)
syeda-anjum
authored

Commits on Feb 11, 2026

minor change to llmd stress test script (#368)
gushob21
authored

Commits on Feb 6, 2026

Implementing llm-d intelligent inference scheduler reference architecture (#364)
gushob21
authored

Commits on Feb 2, 2026

Inference Perf Reference Implementation (#355)

syeda-anjum
and
alizaidis
authored

Commits on Jan 24, 2026

Added examples for vllm speculative decoding with n-gram and eagle methods (#332)
alizaidis
authored

Commits on Jan 15, 2026

Adding support for G4 nvidia-rtx-6000 GPUs for vLLM inference-ref-arch (#345)

syeda-anjum
and
arueth
authored

Commits on Jan 5, 2026

Qwen on tpu (#341)

syeda-anjum
and
arueth
authored

Commits on Nov 14, 2025

Enabled and configured Terraform plugin caching (#333)
arueth
authored

Commits on Nov 5, 2025

Added Gemma 3 1B and 4B IT to GPU vLLM (#328)
arueth
authored

Commits on Oct 31, 2025

Updated links (#322)
arueth
authored

Commits on Oct 30, 2025

Updated online inference scripts and YAMLs (#319)
arueth
authored

Commits on Oct 28, 2025

Updated GKE online inference (#315)
arueth
authored

Commits on Oct 24, 2025

Added diffusion models and standardization for inference on GPU & TPU (#262)

karajendran
and
arueth
authored

Commits on Oct 1, 2025

Added Optimizing GKE Workloads with Custom Compute Classes guide (#289)
arueth
committed

Commits on Aug 27, 2025

Enhancements to HF model download and online GPU manifests (#253)

arueth
and
ferrarimarco
authored

Commits on Aug 25, 2025

docs: inference reference architecture design doc (#248)
ferrarimarco
authored

Commits on Aug 19, 2025

Updated the READMEs to include direct links (#244)
arueth
authored

Commits on Jul 13, 2025

Added Online TPU (#208)

arueth
and
karajendran
authored

Commits on Jul 1, 2025

Added banner (#192)
arueth
authored

Commits on Jun 30, 2025

Updated and restructured documentation (#179)
arueth
authored

Loading