Skip to content

Commit 2e5992f

Browse files
authored
[HWORKS-2193] Remove hard-coded PROJECT_DIR env var in ray config (#324)
1 parent b285702 commit 2e5992f

File tree

2 files changed

+0
-4
lines changed

2 files changed

+0
-4
lines changed

llm-ai-systems/fine-tuning/llama_fine_tune_runtime_env.yaml

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,6 @@ pip:
44
- peft==0.11.1
55
- deepspeed==0.16.2
66
env_vars:
7-
LIBRARY_PATH: "$CUDA_HOME/lib64:$LIBRARY_PATH"
8-
PROJECT_DIR: "/home/yarnapp/hopsfs"
97
TRAINING_DATA_DIR: "${PROJECT_DIR}/Resources/llama_finetuning/datasets" # hopsfs path to training data files
108
TRAINING_CONFIGURATION_DIR: "${PROJECT_DIR}/Resources/llama_finetuning/configs" # hopsfs path to training config files
119
TRAINING_CHECKPOINTS_DIR: "${PROJECT_DIR}/Resources/llama_finetuning/checkpoints" # hopsfs path to torch trainer checkpoints

llm-ai-systems/fine-tuning/llama_fine_tuning_with_ray.ipynb

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -397,8 +397,6 @@
397397
" - peft==0.11.1\n",
398398
" - deepspeed==0.16.2\n",
399399
"env_vars:\n",
400-
" LIBRARY_PATH: \"$CUDA_HOME/lib64:$LIBRARY_PATH\"\n",
401-
" PROJECT_DIR: \"/home/yarnapp/hopsfs\"\n",
402400
" TRAINED_MODEL_STORAGE_PATH: \"${PROJECT_DIR}/Resources/llama_finetuning/fine-tuned-model\" # Where the fine-tuned model will be saved\n",
403401
" TRAINING_DATA_DIR: \"${PROJECT_DIR}/Resources/llama_finetuning/datasets\" # dataset location\n",
404402
" TRAINING_CONFIGURATION_DIR: \"${PROJECT_DIR}/Resources/llama_finetuning/configs\" # location for deepspeed and lora configuration files\n",

0 commit comments

Comments
 (0)