0.6.1.post2
Highlights
- This release contains an important bugfix related to token streaming combined with stop string (#8468)
What's Changed
- [CI/Build] Enable InternVL2 PP test only on single node by @Isotr0py in https://github.com/vllm-project/vllm/pull/8437
- [doc] recommend pip instead of conda by @youkaichao in https://github.com/vllm-project/vllm/pull/8446
- [Misc] Skip loading extra bias for Qwen2-VL GPTQ-Int8 by @jeejeelee in https://github.com/vllm-project/vllm/pull/8442
- [misc][ci] fix quant test by @youkaichao in https://github.com/vllm-project/vllm/pull/8449
- [Installation] Gate FastAPI version for Python 3.8 by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/8456
- [plugin][torch.compile] allow to add custom compile backend by @youkaichao in https://github.com/vllm-project/vllm/pull/8445
- [CI/Build] Reorganize models tests by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/7820
- [Doc] Add oneDNN installation to CPU backend documentation by @Isotr0py in https://github.com/vllm-project/vllm/pull/8467
- [HotFix] Fix final output truncation with stop string + streaming by @njhill in https://github.com/vllm-project/vllm/pull/8468
- bump version to v0.6.1.post2 by @simon-mo in https://github.com/vllm-project/vllm/pull/8473
Full Changelog: https://github.com/vllm-project/vllm/compare/v0.6.1.post1...v0.6.1.post2