Skip to content

Commit 0782a79

Browse files
calvin0327minpeter
authored andcommitted
add an absolute path for run.sh (vllm-project#18258)
Signed-off-by: calvin chen <120380290@qq.com> Signed-off-by: minpeter <kali2005611@gmail.com>
1 parent 86a1f84 commit 0782a79

File tree

1 file changed

+9
-3
lines changed
  • examples/offline_inference/disaggregated-prefill-v1

1 file changed

+9
-3
lines changed
Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,11 @@
11
rm -rf local_storage/
2-
rm output.txt
32

4-
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 prefill_example.py
5-
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 decode_example.py
3+
if [ -f "output.txt" ]; then
4+
rm output.txt
5+
fi
6+
7+
# The directory of current script
8+
SCRIPT_DIR=$(dirname "$(readlink -f "$0")")
9+
10+
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 "$SCRIPT_DIR/prefill_example.py"
11+
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 "$SCRIPT_DIR/decode_example.py"

0 commit comments

Comments
 (0)