V
proto-v0.2.0: vllm-proto 0.2.0
Validated by PR #56538 CI at fa2a26f.
V
v0.29.1rc0
[watermarking] Dual-key gumbel-max watermarking for speculative decod…
V
proto-v0.1.0
vllm-proto 0.1.0
V
v0.29.0
v0.29.0 Highlights This release features 594 commits from 277 contributors (91 new)! Model Runner V2 is now the default for all models (#53183), completing the rollout that began with pooling models (#48290). MRV2 also gained CUDA graph memory profiling for KV cache auto-sizing (#53306), batch-sharded sampling that cuts per-step logits memory by 1/TP (#50465), prompt embeds (#42963), extract_hidde…
V
v0.29.0rc6
[Bugfix][Core] Apply dense prefix cache default to hybrid models (#55…
V
v0.29.0rc5
[Core] Default prefix_cache_retention_interval to dense for Mamba + E…
V
v0.29.0rc4: [Bugfix] Avoid sync in TRT-LLM ragged prefill
Generated-by: Codex codex@openai.com Signed-off-by: Codex codex@openai.com
V
v0.29.0rc3
[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF1…
V
v0.29.0rc2
[Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache …
V
v0.29.0rc1: [Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747)
Signed-off-by: Kevin Luu 51931015+khluu@users.noreply.github.com Signed-off-by: Yongye Zhu zyy1102000@gmail.com Co-authored-by: Codex codex@openai.com Co-authored-by: Yongye Zhu zyy1102000@gmail.com
V
v0.28.1rc0
[Tools][Recipes] Improve sweep recommendations and short-alias parsin…
V
v0.28.0
v0.28.0 Highlights This release features 584 commits from 270 contributors (76 new)! Kimi-K3 performance push: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (DCP) support (#50484), fused FlashKDA decode and prefill kernels (#50654, #51311, #52458), SiTU activation support for MegaMoE (#50510), GEMM-RS for sequence parallelism (#52079), combined all-gathers with…
V
v0.28.0rc2: [Spec Decode] DFlash2: local convolution + candidate selector (#52816)
(cherry picked from commit b389ac2) Signed-off-by: khluu khluu000@gmail.com
V
v0.28.0rc1
[Bugfix][Security] Guard _load_ov2_processor with resolve_trust_remot…
V
v0.27.2rc0: [Spec Decode] DSpark confidence-scheduled verification (#47808)
Signed-off-by: Lucas Wilkinson lwilkins@redhat.com Signed-off-by: Lucas Wilkinson LucasWilkinson@users.noreply.github.com Signed-off-by: Benjamin Chislett chislett.ben@gmail.com Signed-off-by: Lucas Wilkinson wilkinson.lucas@gmail.com Signed-off-by: Nick Hill nickhill123@gmail.com Co-authored-by: OpenAI Codex codex@openai.com Co-authored-by: Claude Opus 5 (1M context) noreply@anthropic.com Co-auth…
V
v0.27.1
This is a patch release on top of v0.27.0. Support quantized DSpark Markov heads (#50424)
V
v0.27.0
vLLM v0.27.0 Release Notes Highlights This release features 561 commits from 242 contributors (64 new)! Kimi K3 support with a full stack landing in one release: core model files and kernels (#50089, #50000), Python (#50093) and Rust (#50104) frontends, AttnRes kernels (#50090), DeepGEMM support (#50458), compressed-tensors quantized checkpoints (#50500), DSpark AR fusion (#50242), and an option t…
V
v0.27.0rc2
v0.27.0rc2
V
v0.27.0rc1
v0.27.0rc1
V
v0.26.1rc0
[CI][ROCm] Fix test_ocp_mx_wikitext_correctness reference value (#4…
V
v0.26.0
vLLM v0.26.0 Release Notes Highlights This release features 411 commits from 212 contributors (61 new)! New Inkling model family with a full support stack: base modeling (#48799), piecewise CUDA graph support (#48822), Hopper FA4 relative attention (#48858), MTP=1 speculative decoding (#48869), LoRA (#48884), and standard ModelOpt NVFP4 quantization (#48990). DeepSeek-V4 performance push across ve…
V
v0.26.0rc1
v0.26.0rc1
V
v0.25.1
vLLM v0.25.1 Highlights This release features 2 commits from 2 contributors (1 new)! v0.25.1 is a patch release containing two targeted bug fixes on top of v0.25.0. Bug Fixes Avoid blocking model launching when no system FFmpeg is available for TorchCodec (#47888). Previously import torchcodec raised a RuntimeError at import time when system FFmpeg was missing, which blocked startup (e.g. vllm ser…
V
v0.25.0
vLLM v0.25.0 Release Notes Highlights This release features 558 commits from 232 contributors (64 new)! Model Runner V2 is now the default for all dense models (#44443). Building on quantized-model support from the previous release, MRv2 is now the standard execution path, with new support for EVS (#46535), realtime embeddings (#46762), prefix caching for Mamba hybrid models (#42406), multimodal-p…
V
v0.25.0rc3
[P/D][Bugfix] Fix PD async KV load lookahead handling for MTP spec de…
V
v0.25.0rc2
Fix embed scaling + CUDA graphs in Transformers modelling backend (#4…
V
v0.25.0rc1
[CPU][Bugfix] Fix flaky ShortConv prefill test on ARM (uninitialized …
V
v0.24.0
vLLM v0.24.0 Release Notes Highlights This release features 571 commits from 256 contributors (77 new)! MiniMax-M3: Added support for the new MiniMax-M3 model (#45381), with a fast follow-on of BF16/FP8 indexer via MSA (#45892), MXFP4 support (#45896), FP8 sparse GQA (#45744), and extensive AMD/ROCm tuning — mxfp8 MoE/linear on gfx950 (#45725), fp8_per_channel for bf16 weights on MI300X (#45854),…
V
v0.24.0rc2: Fix P/D with DP Supervisor (#46628)
Signed-off-by: Robert Shaw 114415538+robertgshaw2-redhat@users.noreply.github.com (cherry picked from commit c5e3c40)
V
v0.24.0rc1: [CI/Build] Fix topk histogram build on SM75 (#46550)
Signed-off-by: Mohammad Miadh Angkad 176301910+mmangkad@users.noreply.github.com (cherry picked from commit 191826e)