Skip to content

Commit 3674ca8

Browse files
committed
restore unrelated files
1 parent b33933c commit 3674ca8

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchtitan/experiments/llama4/train_configs/debug_model.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ tokenizer_path = "./tests/assets/tokenizer"
2727

2828
[optimizer]
2929
# TODO: AdamW has numerical issues when TP is used, need to fix it
30-
name = "Adam"
30+
name = "AdamW"
3131
lr = 4e-3
3232
eps = 1e-15
3333

0 commit comments

Comments
 (0)