Skip to content

[Python][RunInference] vLLM: prefix-aware batching and capacity-based autoscaling - #40908

Draft
AMOOOMA wants to merge 4 commits into
apache:masterfrom
AMOOOMA:pr-vllm-integration
Draft

AMOOOMA wants to merge 4 commits into
apache:masterfrom
AMOOOMA:pr-vllm-integration

[RunInference] vLLM: prefix-aware batching and capacity-based autosca…

24ee97a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Oct 30, 2026 in 13s