Skip to content

Commit ca728f6

Browse files
docs: update pythonpath for starting planner (cherry-pick #890) (#908)
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
1 parent 1613dd5 commit ca728f6

File tree

3 files changed

+4
-4
lines changed

3 files changed

+4
-4
lines changed

components/planner/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ The planner is a component that monitors the state of the system and makes adjus
2424
After you've deployed a dynamo graph, you can start the planner with the following command:
2525

2626
```bash
27-
python components/planner.py --namespace <namespace>
27+
PYTHONPATH=/workspace/examples/llm python components/planner.py --namespace <namespace>
2828
```
2929

3030
## Backends

docs/guides/planner_benchmark/benchmark_planner.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ cd examples/llm
5151
dynamo serve graphs.disagg:Frontend -f <path to disagg_1p1d.yml in this folder> --enable-local-planner
5252

5353
# in terminal 2
54-
python components/planner.py \
54+
PYTHONPATH=/workspace/examples/llm python components/planner.py \
5555
--metric-pulling-interval 1 \
5656
--adjustment-interval 10 \
5757
--prefill-queue-scale-down-threshold 0.2 \
@@ -95,7 +95,7 @@ In this example, we use a fixed 2p2d engine as baseline. Planner provides a `--n
9595
dynamo serve --enable-local-planner graphs.disagg:Frontend -f disagg_2p2d.yml
9696

9797
# in terminal 2 (optional)
98-
python components/planner.py --no-operation --log-dir log/2p2d
98+
PYTHONPATH=/workspace/examples/llm python components/planner.py --no-operation --log-dir log/2p2d
9999

100100
# in terminal 3
101101
genai-perf profile --tokenizer deepseek-ai/DeepSeek-R1-Distill-Llama-8B -m deepseek-ai/DeepSeek-R1-Distill-Llama-8B --service-kind openai --endpoint-type chat --url http://localhost:8000 --streaming --input-file payload:sin_b512_t600_rr5.0-20.0-150.0_io3000150-3000150-0.2-0.8-10.jsonl

docs/planner.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ There are two additional rules set by planner to prevent over-compensation:
5151
## Usage
5252
After you've deployed a dynamo graph - you can start the planner with the following command:
5353
```bash
54-
python components/planner.py <arguments>
54+
PYTHONPATH=/workspace/examples/llm python components/planner.py <arguments>
5555
```
5656

5757
Planner takes the following arguments:

0 commit comments

Comments
 (0)