Skip to content

Commit 84f9e48

Browse files
sviluppToucheSir
andauthored
Update docs/src/training/training.md
Co-authored-by: Brian Chen <ToucheSir@users.noreply.github.com>
1 parent 886edba commit 84f9e48

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/src/training/training.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -178,8 +178,8 @@ function my_custom_train!(loss, ps, data, opt)
178178
end
179179
# Insert whatever code you want here that needs training_loss, e.g. logging.
180180
# logging_callback(training_loss)
181-
# Insert whatever code you want here that needs gradient.
182-
# E.g. logging with TensorBoardLogger.jl as a histogram so you can see if it is becoming huge.
181+
# Insert whatever code you want here that needs gradients.
182+
# e.g. logging histograms with TensorBoardLogger.jl to check for exploding gradients.
183183
update!(opt, ps, gs)
184184
# Here you might like to check validation set accuracy, and break out to do early stopping.
185185
end

0 commit comments

Comments
 (0)