Skip to content

Pull requests: vllm-project/vllm

New pull request New
405 Open 4,282 Closed
405 Open 4,282 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix M-RoPE position calculation when chunked prefill is enabled
#10388 opened Nov 16, 2024 by imkero Loading…
1
[CI/Build] Fix IDC hpu [Device not found] issue ci/build
#10384 opened Nov 16, 2024 by xuechendi Loading…
2
[2/N][torch.compile] make compilation cfg part of vllm cfg
#10383 opened Nov 15, 2024 by youkaichao Loading…
2
[v1] V1EngineArgs for better config handling ci/build
#10382 opened Nov 15, 2024 by rickyyx Loading…
3
[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU
#10375 opened Nov 15, 2024 by HollowMan6 Loading…
1
[V1] Refactor model executable interface for all text-only language models
#10374 opened Nov 15, 2024 by ywang96 Loading…
3
[Doc] Add the start of an arch overview page documentation Improvements or additions to documentation
#10368 opened Nov 15, 2024 by russellb Loading…
3
[CI/Build] Add sphinx/rst linter for docs ci/build
#10366 opened Nov 15, 2024 by rafvasq • Draft
6
[Misc] Medusa supports custom bias ready ONLY add when PR is ready to merge/full CI is needed
#10361 opened Nov 15, 2024 by skylee-01 Loading…
2
[Platform][Refactor] Extract func get_default_attn_backend to Platform ready ONLY add when PR is ready to merge/full CI is needed
#10358 opened Nov 15, 2024 by MengqingCao Loading…
3
[Hardware][CPU] Support chunked-prefill and prefix-caching on CPU ci/build documentation Improvements or additions to documentation x86 CPU
#10355 opened Nov 15, 2024 by bigPYJ1151 Loading…
9
Add KV-Cache int8 quant support
#10354 opened Nov 15, 2024 by YanyunDuanIEI Loading…
1
[Core] Interface for accessing model from engine
#10353 opened Nov 15, 2024 by DarkLight1337 Loading…
6
[DRAFT] Cutlass 2:4 ci/build needs-rebase
#10346 opened Nov 15, 2024 by robertgshaw2-neuralmagic • Draft
2
Rahul quant merged ci/build needs-rebase
#10341 opened Nov 14, 2024 by robertgshaw2-neuralmagic • Draft
3
[Kernel] Add CUTLASS sparse support, heuristics, and torch operators ci/build
#10340 opened Nov 14, 2024 by Faraz9877 Loading…
4
[Feature] enable host memory for kv cache
#10330 opened Nov 14, 2024 by YZP17121579 • Draft
2
Rs 24 sparse ci/build needs-rebase
#10329 opened Nov 14, 2024 by robertgshaw2-neuralmagic • Draft
2
[Misc] Add uninitialized params tracking for AutoWeightsLoader needs-rebase
#10327 opened Nov 14, 2024 by Isotr0py • Draft
@DarkLight1337
2
DistServe Prototype
#10321 opened Nov 14, 2024 by Jocn2020 • Draft
1
[Model] Support telechat2
#10311 opened Nov 14, 2024 by shunxing12345 Loading…
1
8
[TPU] Implement prefix caching for TPUs ci/build tpu Related to Google TPUs
#10307 opened Nov 13, 2024 by WoosukKwon • Draft
9
[Model] Add Support for Multimodal Granite Models
#10291 opened Nov 13, 2024 by alex-jw-brooks Loading…
@DarkLight1337
8
[Core][Frontend] Add faster-outlines as guided decoding backend ci/build
#10277 opened Nov 13, 2024 by unaidedelf8777 Loading…
6
[torch.compile] PostGradPassManager, Inductor code caching fix, fix_functionalization pass refactor + tests ready ONLY add when PR is ready to merge/full CI is needed
#10273 opened Nov 12, 2024 by ProExpertProg Loading…
16
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.