Skip to content

Commit 94527a0

Browse files
committed
restore unrelated files
1 parent 2d7f2ac commit 94527a0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchtitan/experiments/llama4/train_configs/debug_model.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ tokenizer_path = "./tests/assets/test_tiktoken.model"
2727

2828
[optimizer]
2929
# TODO: AdamW has numerical issues when TP is used, need to fix it
30-
name = "Adam"
30+
name = "AdamW"
3131
lr = 4e-3
3232
eps = 1e-15
3333

0 commit comments

Comments
 (0)