vLLM 0.9.2 release notes

Highlights

This release contains 452 commits from 167 contributors (31 new!)

NOTE: This is the last version where V0 engine code and features stay intact. We highly recommend migrating to V1 engine.

Engine Core

Priority Scheduling is now implemented in V1 engine (#19057), embedding models in V1 (#16188), Mamba2 in V1 (#19327).
Full CUDA‑Graph execution is now available for all FlashAttention v3 (FA3) and FlashMLA paths, including prefix‑caching. CUDA graph now has a live capture progress bar makes debugging easier (#20301, #18581, #19617, #19501).
FlexAttention update – any head size, FP32 fallback (#20467, #19754).
Shared CachedRequestData objects and cached sampler‑ID stores deliver perf enhancements (#20232, #20291).

Model Support

New families: Ernie 4.5 (+MoE) (#20220), MiniMax‑M1 (#19677, #20297), Slim‑MoE “Phi‑tiny‑MoE‑instruct” (#20286), Tencent HunYuan‑MoE‑V1 (#20114), Keye‑VL‑8B‑Preview (#20126), GLM‑4.1 V (#19331), Gemma‑3 (text‑only, #20134), Tarsier 2 (#19887), Qwen 3 Embedding & Reranker (#19260), dots1 (#18254), GPT‑2 for Sequence Classification (#19663).
Granite hybrid MoE configurations with shared experts are fully supported (#19652).

Large‑Scale Serving & Engine Improvements

Expert‑Parallel Load Balancer (EPLB) has been added! (#18343, #19790, #19885).
Disaggregated serving enhancements: Avoid stranding blocks in P when aborted in D's waiting queue (#19223), let toy proxy handle /chat/completions (#19730)
Native xPyD P2P NCCL transport as a base case for native PD without external dependency (#18242, #20246).

Hardware & Performance

NVIDIA Blackwell
- SM120: CUTLASS W8A8/FP8 kernels and related tuning, added to Dockerfile (#17280, #19566, #20071, #19794)
- SM100: block‑scaled‑group GEMM, INT8/FP8 vectorization, deep‑GEMM kernels, activation‑chunking for MoE, and group‑size 64 for Machete (#19757, #19572, #19168, #19085, #20290, #20331).
Intel GPU (V1) backend with Flash‑Attention support (#19560).
AMD ROCm: full‑graph capture for TritonAttention, quick All‑Reduce, and chunked pre‑fill (#19158, #19744, #18596).
- Split‑KV support landed in the unified Triton Attention kernel, boosting long‑context throughput (#19152).
- Full‑graph mode enabled in ROCm AITER MLA V1 decode path (#20254).
TPU: dynamic‑grid KV‑cache updates, head‑dim less than 128, tuned paged‑attention kernels, and KV‑padding fixes (#19928, #20235, #19620, #19813, #20048, #20339).
- Add models and features supporting matrix. (#20230)

Quantization

Calibration‑free RTN INT4/INT8 pipeline for effortless, accurate compression (#18768).
Compressed‑Tensor NVFP4 (including MoE) + emulation; FP4 emulation removed on < SM100 devices (#19879, #19990, #19563).
Dynamic MoE‑layer quant (Marlin/GPTQ) and INT8 vectorization primitives (#19395, #20331, #19233).
Bits‑and‑Bytes 0.45 + with improved double‑quant logic and AWQ quality (#20424, #20033, #19431, #20076).

API · CLI · Frontend

API Server: Eliminate api_key and x_request_id headers middleware overhead (#19946)
New OpenAI‑compatible endpoints: /v1/audio/translations & revamped /v1/audio/transcriptions (#19615, #20179, #19597).
Token‑level progress bar for LLM.beam_search and cached template‑resolution speed‑ups (#19301, #20065).
Image‑object support in llm.chat, tool‑choice expansion, and custom‑arg passthroughs enrich multi‑modal agents (#19635, #17177, #16862).
CLI QoL: better parsing for -O/--compilation-config, batch‑size‑sweep benchmarking, richer --help, faster startup (#20156, #20516, #20430, #19941).
Metrics: Deprecate metrics with gpu_ prefix for non GPU specific metrics (#18354), Export NaNs in logits to scheduler_stats if output is corrupted (#18777)

Platform & Deployment

No‑privileged CPU / Docker / K8s mode (#19241) and custom default max‑tokens for hosted platforms (#18557).
Security hardening – runtime (cloud)pickle imports forbidden (#18018).
Hermetic builds and wheel slimming (FA2 8.0 + PTX only) shrink supply‑chain surface (#18064, #19336).

What's Changed

[Docs] Note that alternative structured output backends are supported by @russellb in https://github.com/vllm-project/vllm/pull/19426
[ROCm][V1] Adding ROCm to the list of plaforms using V1 by default by @gshtras in https://github.com/vllm-project/vllm/pull/19440
[Model] use AutoWeightsLoader for commandr by @py-andy-c in https://github.com/vllm-project/vllm/pull/19399
Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B-FP8 by @Xu-Wenqing in https://github.com/vllm-project/vllm/pull/19401
[BugFix] Allow use_cudagraph to work with dynamic VLLM_USE_V1 by @zou3519 in https://github.com/vllm-project/vllm/pull/19390
[New Model]: Support Qwen3 Embedding & Reranker by @noooop in https://github.com/vllm-project/vllm/pull/19260
[BugFix] Fix docker build cpu-dev image error by @2niuhe in https://github.com/vllm-project/vllm/pull/19394
Fix test_max_model_len in tests/entrypoints/llm/test_generate.py by @houseroad in https://github.com/vllm-project/vllm/pull/19451
[CI] Disable failing GGUF model test by @mgoin in https://github.com/vllm-project/vllm/pull/19454
[Misc] Remove unused MultiModalHasher.hash_prompt_mm_data by @lgeiger in https://github.com/vllm-project/vllm/pull/19422
Add fused MOE config for Qwen3 30B A3B on B200 by @0xjunhao in https://github.com/vllm-project/vllm/pull/19455
Fix Typo in Documentation and Function Name by @leopardracer in https://github.com/vllm-project/vllm/pull/19442
[ROCm] Add rules to automatically label ROCm related PRs by @houseroad in https://github.com/vllm-project/vllm/pull/19405
[Kernel] Support deep_gemm for linear methods by @artetaout in https://github.com/vllm-project/vllm/pull/19085
[Doc] Update V1 User Guide for Hardware and Models by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/19474
[Doc] Fix quantization link titles by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/19478
[Doc] Support "important" and "announcement" admonitions by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/19479
[Misc] Reduce warning message introduced in env_override by @houseroad in https://github.com/vllm-project/vllm/pull/19476
Support non-string values in JSON keys from CLI by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/19471
Add cache to cuda get_device_capability by @mgoin in https://github.com/vllm-project/vllm/pull/19436
Fix some typo by @Ximingwang-09 in https://github.com/vllm-project/vllm/pull/19475
Support no privileged mode on CPU for docker and kubernetes deployments by @louie-tsai in https://github.com/vllm-project/vllm/pull/19241
[Bugfix] Update the example code, make it work with the latest lmcache by @runzhen in https://github.com/vllm-project/vllm/pull/19453
[CI] Update FlashInfer to 0.2.6.post1 by @mgoin in https://github.com/vllm-project/vllm/pull/19297
[doc] fix "Other AI accelerators" getting started page by @davidxia in https://github.com/vllm-project/vllm/pull/19457
[Misc] Fix misleading ROCm warning by @jeejeelee in https://github.com/vllm-project/vllm/pull/19486
[Docs] Remove WIP features in V1 guide by @WoosukKwon in https://github.com/vllm-project/vllm/pull/19498
[Kernels] Add activation chunking logic to FusedMoEModularKernel by @bnellnm in https://github.com/vllm-project/vllm/pull/19168
[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger by @rasmith in https://github.com/vllm-project/vllm/pull/17331
[UX] Add Feedback During CUDAGraph Capture by @robertgshaw2-redhat in https://github.com/vllm-project/vllm/pull/19501
[CI/Build] Fix torch nightly CI dependencies by @zou3519 in https://github.com/vllm-project/vllm/pull/19505
[CI] change spell checker from codespell to typos by @andyxning in https://github.com/vllm-project/vllm/pull/18711
[BugFix] Force registration of w8a8_block_fp8_matmul_deepgemm via lazy import by @varun-sundar-rabindranath in https://github.com/vllm-project/vllm/pull/19514
Add Triton Fused MoE kernel config for E=16 on B200 by @b8zhong in https://github.com/vllm-project/vllm/pull/19518
[Frontend] Improve error message in tool_choice validation by @22quinn in https://github.com/vllm-project/vllm/pull/19239
[BugFix] Work-around incremental detokenization edge case error by @njhill in https://github.com/vllm-project/vllm/pull/19449
[BugFix] Handle missing sep_token for Qwen3-Reranker in Score API by @strutive07 in https://github.com/vllm-project/vllm/pull/19522
[AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm by @rasmith in https://github.com/vllm-project/vllm/pull/19509
Fix typo by @2niuhe in https://github.com/vllm-project/vllm/pull/19525
[Security] Prevent new imports of (cloud)pickle by @russellb in https://github.com/vllm-project/vllm/pull/18018
[Bugfix][V1] Allow manual FlashAttention for Blackwell by @mgoin in https://github.com/vllm-project/vllm/pull/19492
[Bugfix] Respect num-gpu-blocks-override in v1 by @jmswen in https://github.com/vllm-project/vllm/pull/19503
[Quantization] Improve AWQ logic by @jeejeelee in https://github.com/vllm-project/vllm/pull/19431
[Doc] Add V1 column to supported models list by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/19523
[NixlConnector] Drop num_blocks check by @NickLucche in https://github.com/vllm-project/vllm/pull/19532
[Perf] Vectorize static / dynamic INT8 quant kernels by @yewentao256 in https://github.com/vllm-project/vllm/pull/19233
Fix TorchAOConfig skip layers by @mobicham in https://github.com/vllm-project/vllm/pull/19265
[torch.compile][ROCm] Fuse quantization onto attention using a torch.compile pass by @ProExpertProg in https://github.com/vllm-project/vllm/pull/16756
[doc] Make top navigation sticky by @reidliu41 in https://github.com/vllm-project/vllm/pull/19540
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets by @ekagra-ranjan in https://github.com/vllm-project/vllm/pull/18847
[Misc] Turn MOE_DP_CHUNK_SIZE into an env var by @varun-sundar-rabindranath in https://github.com/vllm-project/vllm/pull/19506
[Bugfix] Enforce contiguous input for dynamic_per_token FP8/INT8 quant by @mgoin in https://github.com/vllm-project/vllm/pull/19452
[Doc] Unify structured outputs examples by @aarnphm in https://github.com/vllm-project/vllm/pull/18196
[V1] Resolve failed concurrent structred output requests by @russellb in https://github.com/vllm-project/vllm/pull/19565
Revert "[Build/CI] Add tracing deps to vllm container image (#15224)" by @kouroshHakha in https://github.com/vllm-project/vllm/pull/19378
[BugFix] : Fix Batched DeepGemm Experts by @varun-sundar-rabindranath in https://github.com/vllm-project/vllm/pull/19515
[Bugfix] Fix EAGLE vocab embedding for multimodal target model by @zixi-qi in https://github.com/vllm-project/vllm/pull/19570
[Doc] uses absolute links for structured outputs by @aarnphm in https://github.com/vllm-project/vllm/pull/19582
[doc] fix incorrect link by @reidliu41 in https://github.com/vllm-project/vllm/pull/19586
[Misc] Correct broken docs link by @Zerohertz in https://github.com/vllm-project/vllm/pull/19553
[CPU] Refine default config for the CPU backend by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/19539
[Fix] bump mistral common to support magistral by @princepride in https://github.com/vllm-project/vllm/pull/19533
[Fix] The zip function in Python 3.9 does not have the strict argument by @princepride in https://github.com/vllm-project/vllm/pull/19549
use base version for version comparison by @BoyuanFeng in https://github.com/vllm-project/vllm/pull/19587
[torch.compile] reorganize the cache directory to support compiling multiple models by @youkaichao in https://github.com/vllm-project/vllm/pull/19064
[BugFix] Honor enable_caching in connector-delayed kvcache load case by @njhill in https://github.com/vllm-project/vllm/pull/19435
[Model] Fix minimax model cache & lm_head precision by @qscqesze in https://github.com/vllm-project/vllm/pull/19592
[Refactor] Remove unused variables in moe_permute_unpermute_kernel.inl by @yewentao256 in https://github.com/vllm-project/vllm/pull/19573
[doc][mkdocs] fix the duplicate Supported features sections in GPU docs by @reidliu41 in https://github.com/vllm-project/vllm/pull/19606
[CUDA] Enable full cudagraph for FlashMLA by @ProExpertProg in https://github.com/vllm-project/vllm/pull/18581
[Doc] Add troubleshooting section to k8s deployment by @annapendleton in https://github.com/vllm-project/vllm/pull/19377
[torch.compile] Use custom ops when use_inductor=False by @WoosukKwon in https://github.com/vllm-project/vllm/pull/19618
Adding "AMD: Multi-step Tests" to amdproduction. by @Concurrensee in https://github.com/vllm-project/vllm/pull/19508
[BugFix] Fix DP Coordinator incorrect debug log message by @njhill in https://github.com/vllm-project/vllm/pull/19624
[V1][Metrics] Deprecate metrics with gpu_ prefix for non GPU specific metrics. by @sahelib25 in https://github.com/vllm-project/vllm/pull/18354
[Bugfix][1/n] Fix the speculative decoding test by setting the target dtype by @houseroad in https://github.com/vllm-project/vllm/pull/19633
[Misc] Modularize CLI Argument Parsing in Benchmark Scripts by @reidliu41 in https://github.com/vllm-project/vllm/pull/19593
[Bugfix] Fix auto dtype casting for BatchFeature by @Isotr0py in https://github.com/vllm-project/vllm/pull/19316
[Hardware][NVIDIA][kernel] Fp4 MOE quant kernel optimization by @jiahanc in https://github.com/vllm-project/vllm/pull/19500
Only build CUTLASS MoE kernels on Hopper by @huydhn in https://github.com/vllm-project/vllm/pull/19648
[Bugfix] Don't attempt to use triton if no driver is active by @kzawora-intel in https://github.com/vllm-project/vllm/pull/19561
[Fix] Convert kv_transfer_config from dict to KVTransferConfig by @maobaolong in https://github.com/vllm-project/vllm/pull/19262
[Perf] Further tunings for SM100 FP8 CUTLASS kernel by @ilmarkov in https://github.com/vllm-project/vllm/pull/19566
[Bugfix][2/n] Fix speculative decoding CI - Fix test_ngram_e2e_greedy_correctness by @houseroad in https://github.com/vllm-project/vllm/pull/19644
[Kernel] Raise verbose error and consolidate num_heads/num_kv_heads divisibility check by @22quinn in https://github.com/vllm-project/vllm/pull/19339
[Benchmark] Refactor benchmark script for fp8 & int8 by @yewentao256 in https://github.com/vllm-project/vllm/pull/19627
Enable prefix caching with full cuda graphs by @WoosukKwon in https://github.com/vllm-project/vllm/pull/19617
[CI/Build] Fix torch nightly CI dependencies part 2 by @zou3519 in https://github.com/vllm-project/vllm/pull/19589
[Misc] Remove duplicate multiproc method setting for CPU platform by @Isotr0py in https://github.com/vllm-project/vllm/pull/19649
[MISC] Remove unused variableds in C++ by @houseroad in https://github.com/vllm-project/vllm/pull/19609
[Bugfix][Core] Prefix caching causes incorrect outputs due to outdated ComputedBlocksTracker by @quanliu1991 in https://github.com/vllm-project/vllm/pull/18957
[Misc][Frontend] passthrough bad_words by @f14-bertolotti in https://github.com/vllm-project/vllm/pull/19564
[Misc] Fix skipped max-model-len validation when deriving max model length from tokenizer config by @yeqcharlotte in https://github.com/vllm-project/vllm/pull/19660
[TPU] support attention head dim smaller than 128 by @yaochengji in https://github.com/vllm-project/vllm/pull/19620
[MISC] typo fix by @andyxning in https://github.com/vllm-project/vllm/pull/19672
[CI] Add mteb testing for rerank models by @noooop in https://github.com/vllm-project/vllm/pull/19344
[Docs] Move multiproc doc to v1 dir by @russellb in https://github.com/vllm-project/vllm/pull/19651
[Kernel] GGUF MMVQ kernel for multiple input vectors by @SzymonOzog in https://github.com/vllm-project/vllm/pull/18754
[BugFix] Don't catch BaseException when dumping execute_model errors by @njhill in https://github.com/vllm-project/vllm/pull/19626
[DOC] Add reasoning capability to vLLM streamlit code by @Navanit-git in https://github.com/vllm-project/vllm/pull/19557
[Feature]:Allow for Granite MoE Hybrid models with only shared experts. by @shawntan in https://github.com/vllm-project/vllm/pull/19652
[Bugfix] Fix TP inference for Flex attention backend by @Isotr0py in https://github.com/vllm-project/vllm/pull/19657
[MISC] bump huggingface_hub pkg to 0.33.0 by @andyxning in https://github.com/vllm-project/vllm/pull/19547
[Bugfix] fix missing 'finish_reason': null in streaming chat by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/19662
[Kernels] Use empty for modular MoE workspaces by @bnellnm in https://github.com/vllm-project/vllm/pull/19667
[Model] Add support for MiniMaxM1ForCausalLM (shares architecture with MiniMaxText01ForCausalLM) by @qscqesze in https://github.com/vllm-project/vllm/pull/19677
[V1] Change return type on get_multimodal_embeddings() by @russellb in https://github.com/vllm-project/vllm/pull/19446
[Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 by @dsikka in https://github.com/vllm-project/vllm/pull/19563
[Fix] Fall back to Gloo when NCCL backend is unavailable by @conroy-cheers in https://github.com/vllm-project/vllm/pull/19641
[doc] add project flag to gcloud TPU command by @davidxia in https://github.com/vllm-project/vllm/pull/19664
[Wheel Size] Only build FA2 8.0+PTX by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/19336
[Frontend] add chunking audio for > 30s audio by @nguyenhoangthuan99 in https://github.com/vllm-project/vllm/pull/19597
[DOC] fix doc typos by @diliu0349 in https://github.com/vllm-project/vllm/pull/19600
Fixes IMA for TP w/ flex-attention by @drisspg in https://github.com/vllm-project/vllm/pull/19712
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager by @quanliu1991 in https://github.com/vllm-project/vllm/pull/19686
[Doc] Add missing llava family multi-image examples by @Isotr0py in https://github.com/vllm-project/vllm/pull/19698
Add a doc on how to update PyTorch version by @huydhn in https://github.com/vllm-project/vllm/pull/19705
[Kernel] Add Split-KV Support to Unified Triton Attention Kernel by @jvlunteren in https://github.com/vllm-project/vllm/pull/19152
[doc][mkdocs] Add edit button to documentation by @reidliu41 in https://github.com/vllm-project/vllm/pull/19637
[doc] split "Other AI Accelerators" tabs by @davidxia in https://github.com/vllm-project/vllm/pull/19708
[V1][Kernel] Flashinfer HND KV cache layout by @NickLucche in https://github.com/vllm-project/vllm/pull/19280
[Mis] remove duplicate engine status checks by @googs1025 in https://github.com/vllm-project/vllm/pull/19647
[Bugfix] Update multimodel models mapping to fit new checkpoint after Transformers v4.52 by @Isotr0py in https://github.com/vllm-project/vllm/pull/19151
[Perf] Optimize moe_align_block_size CUDA kernel by @yewentao256 in https://github.com/vllm-project/vllm/pull/19572
Remove sm120 arch from sm100 cutlass kernel arch list by @mgoin in https://github.com/vllm-project/vllm/pull/19716
[Misc] Update lmcache connector with the latest connector apis by @YaoJiayi in https://github.com/vllm-project/vllm/pull/19441
[Bugfix] Fix faulty triton importing logic when using Ray for DP by @mgoin in https://github.com/vllm-project/vllm/pull/19734
[Feature][ROCm] Add full graph capture support for TritonAttentionBackend by @charlifu in https://github.com/vllm-project/vllm/pull/19158
[TPU] Update torch version to include paged attention kernel change by @Chenyaaang in https://github.com/vllm-project/vllm/pull/19706
[MISC] correct copy_blocks src_to_dists param type by @andyxning in https://github.com/vllm-project/vllm/pull/19696
[MISC] correct DeviceConfig device field static type analysis by @andyxning in https://github.com/vllm-project/vllm/pull/19699
[Misc] Add str for RequestStatus by @lk-chen in https://github.com/vllm-project/vllm/pull/19780
[V1] Add API docs for EncoderCacheManager by @russellb in https://github.com/vllm-project/vllm/pull/19294
[V1][P/D] An native implementation of xPyD based on P2P NCCL by @Abatom in https://github.com/vllm-project/vllm/pull/18242
[V1] Decouple GPU and TPU InputBatch by @afeldman-nm in https://github.com/vllm-project/vllm/pull/19778
[Minor] Zero-initialize attn output buffer by @WoosukKwon in https://github.com/vllm-project/vllm/pull/19784
[doc] fix the incorrect label by @reidliu41 in https://github.com/vllm-project/vllm/pull/19787
[Platform] Allow platform use V1 Engine by default by @wangxiyuan in https://github.com/vllm-project/vllm/pull/19792
[Qwen] Add tagging rule for Qwen related PRs by @houseroad in https://github.com/vllm-project/vllm/pull/19799
[Hardware][AMD] integrate aiter chunked prefill into vllm by @Zzz9990 in https://github.com/vllm-project/vllm/pull/18596
[Bugfix] fix RAY_CGRAPH_get_timeout is not set successfully by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/19725
[Docs] Add Huzaifa Sidhpurwala to vuln mgmt team doc by @russellb in https://github.com/vllm-project/vllm/pull/19808
[v1] Support mamba2 by @heheda12345 in https://github.com/vllm-project/vllm/pull/19327
docs: fix Slack bulletpoint in README by @nathan-weinberg in https://github.com/vllm-project/vllm/pull/19811
Disable "Forbid direct 'import triton'" check for vllm/triton_utils/importing.py in an extensible way by @afeldman-nm in https://github.com/vllm-project/vllm/pull/19783
[Core] Do not copy array during hashing by @lgeiger in https://github.com/vllm-project/vllm/pull/19484
[TPU] Update torch-xla version to include paged attention tuned block change by @QiliangCui in https://github.com/vllm-project/vllm/pull/19813
[Core] More fixes to MultiModalEmbeddings type handling by @russellb in https://github.com/vllm-project/vllm/pull/19715
[Multimodal] Use fast processor for Qwen2/2.5-VL by @WoosukKwon in https://github.com/vllm-project/vllm/pull/19789
[BugFix] Fix use_cudagraph=False by @zou3519 in https://github.com/vllm-project/vllm/pull/19612
[Frontend] Expose custom args in OpenAI APIs by @afeldman-nm in https://github.com/vllm-project/vllm/pull/16862
Fix FA2 fallback for Blackwell V1 by @mgoin in https://github.com/vllm-project/vllm/pull/19781
[Misc][ROCm] Enforce no unused variable in ROCm C++ files by @houseroad in https://github.com/vllm-project/vllm/pull/19796
[Quantization] Modify the logic of BNB double quantization by @jeejeelee in https://github.com/vllm-project/vllm/pull/19742
Support embedding models in V1 by @maxdebayser in https://github.com/vllm-project/vllm/pull/16188
[Bugfix] Fix the linter by @houseroad in https://github.com/vllm-project/vllm/pull/19826
[Bugfix] Add check_health to v1 async client. by @kouroshHakha in https://github.com/vllm-project/vllm/pull/19821
Mark invariant normalizer in Gemma as non-persistent by @yhtang in https://github.com/vllm-project/vllm/pull/19788
[ROCm] [AITER] [Bugfix] Patch for AITER commit 648764942e552a8bb5fe16026703716a81f05374 by @tjtanaa in https://github.com/vllm-project/vllm/pull/18990
[Misc] [ROCm] Prevent surplus tensor reshape by @zsolt-borbely-htec in https://github.com/vllm-project/vllm/pull/19803
raise exception for pin_lora by @andyxning in https://github.com/vllm-project/vllm/pull/19809
[Minor] Allow redirecting model path for HfRunner in test by @Isotr0py in https://github.com/vllm-project/vllm/pull/19795
Add xLAM tool parser support by @zuxin666 in https://github.com/vllm-project/vllm/pull/17148
[Frontend] Add optional token-level progress bar to LLM.beam_search by @NekoMimiUnagi in https://github.com/vllm-project/vllm/pull/19301
Fixing Chunked Prefill Test. by @Alexei-V-Ivanov-AMD in https://github.com/vllm-project/vllm/pull/19762
[Doc] Update V1 user guide for embedding models by @22quinn in https://github.com/vllm-project/vllm/pull/19842
[CI][CPU] Improve dummy Triton interfaces and fix the CPU CI by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/19838
[Core][Bugfix] Fix Online MM Beam Search by @alex-jw-brooks in https://github.com/vllm-project/vllm/pull/19688
[Frontend] early return chat format resolution when specified by @xzbdmw in https://github.com/vllm-project/vllm/pull/19735
[Benchmark][Bugfix] Fix Dataset Length Calculation by @robertgshaw2-redhat in https://github.com/vllm-project/vllm/pull/19868
[CI/Build][Bugfix] Fix deadlock on v1 engine test CI by @Isotr0py in https://github.com/vllm-project/vllm/pull/19872
[CI][Neuron] Fail and exit on first error by @elaineyz in https://github.com/vllm-project/vllm/pull/19622
[Benchmark] Fix Value of type "SampleRequest" is not indexable by @b8zhong in https://github.com/vllm-project/vllm/pull/18032
[Chore]: qwen3-moe-type-hints-mistake by @Xerxes-cn in https://github.com/vllm-project/vllm/pull/19860
[Bugfix] Enable PP with AITER+V1 by @qli88 in https://github.com/vllm-project/vllm/pull/19822
[Bugfix][Ray] Set the cuda context eagerly in the ray worker by @kouroshHakha in https://github.com/vllm-project/vllm/pull/19583
[Misc] update cuda version by @reidliu41 in https://github.com/vllm-project/vllm/pull/19526
[Misc] refactor example - openai_transcription_client by @reidliu41 in https://github.com/vllm-project/vllm/pull/19851
[Kernel] correct cpu worker function parameter type by @andyxning in https://github.com/vllm-project/vllm/pull/19745
[Fix] import regex instead of re by @tdoublep in https://github.com/vllm-project/vllm/pull/19875
[Model] GPT2ForSequenceClassification model by @nie3e in https://github.com/vllm-project/vllm/pull/19663
[custom_op][vllm-plugin] update custom_op class to use op_registry by @xuechendi in https://github.com/vllm-project/vllm/pull/19164
Export NaNs in logits to scheduler_stats if output is corrupted by @vladmihailescu in https://github.com/vllm-project/vllm/pull/18777
[CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/19901
[Kernel] mark TorchSDPABackend swap_blocks NotImplementedError by @andyxning in https://github.com/vllm-project/vllm/pull/19749
[Misc] Clean up useless code by @wangxiyuan in https://gi