Search results

[Bug]: No protection for multiple PodAutoscalers targeting the same workload

Status: Open.

#1661 In vllm-project/aibrix;

· googs1025 opened on Oct 13, 2025

tp=2，pp=2时，kvcache存储时是只存储 rank0 节点的kvcache嘛？还是说rank0-ran3 的kv都进行存储

Status: Open.

#1660 In vllm-project/aibrix;

· tianlang-wq opened on Oct 13, 2025

[Discussion] Simplify AIBrix deployment by removing Envoy Gateway

Status: Open.

#1656 In vllm-project/aibrix;

· Jeffwan opened on Oct 11, 2025

[batch] Build resource provider layer for batch workloads

area/batch

Status: Open.

#1655 In vllm-project/aibrix;

· Jeffwan opened on Oct 11, 2025

[batch] The constant shows DEFAULT_JOB_POOL_SIZE = 1 this should be configurable.

Status: Open.

#1654 In vllm-project/aibrix;

· Jeffwan opened on Oct 11, 2025

[batch] Currently only /v1/chat/completions is tested. We need to expand to <code>/v1/completions</code> or <code>/v1/embeddings</code> and <code>/v1/moderation</code> at least

Status: Open.

#1653 In vllm-project/aibrix;

· Jeffwan opened on Oct 11, 2025

[batch] Error File Creation: The metadata server workflow test mentions error_file_id, but I don't see specific error file generation logic in the test. Is this working as expected?

Status: Open.

#1652 In vllm-project/aibrix;

· Jeffwan opened on Oct 11, 2025

[batch] File List API missing: seems the file list API is not available. which is missing in our implementation.

Status: Open.

#1651 In vllm-project/aibrix;

· Jeffwan opened on Oct 11, 2025

[podautoscaler]: add podautoscaler controller in integration test

area/autoscaling

area/testingIssues or PRs related to testingIssues or PRs related to testing

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1650 In vllm-project/aibrix;

· googs1025 opened on Oct 11, 2025

[podautoscaler]: add more unit test in podautoscaler controller

area/autoscaling

area/testingIssues or PRs related to testingIssues or PRs related to testing

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1649 In vllm-project/aibrix;

· googs1025 opened on Oct 11, 2025

[RFC]: stormservice support vllm and sglang multiple-node deployment

area/orchestration

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#1647 In vllm-project/aibrix;

· ying2025 opened on Oct 11, 2025

batch api doesn't work as expected.

area/batch

kind/bugSomething isn't workingSomething isn't working

priority/critical-urgentHighest priority. Must be actively worked on as someone's top priority right now.Highest priority. Must be actively worked on as someone's top priority right now.

Status: Open.

#1645 In vllm-project/aibrix;

· Jeffwan opened on Oct 10, 2025