Skip to content

Commit 6235c2a

Browse files
Update "Composing Optimisers" docs
Use `1` instead of `0.001` for first argument of `ExpDecay` in example.
1 parent de76e08 commit 6235c2a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/src/training/optimisers.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@ Flux defines a special kind of optimiser simply called `Optimiser` which takes i
107107
that will be fed into the next, and the resultant update will be applied to the parameter as usual. A classic use case is where adding decays is desirable. Flux defines some basic decays including `ExpDecay`, `InvDecay` etc.
108108

109109
```julia
110-
opt = Optimiser(ExpDecay(0.001, 0.1, 1000, 1e-4), Descent())
110+
opt = Optimiser(ExpDecay(1, 0.1, 1000, 1e-4), Descent())
111111
```
112112

113113
Here we apply exponential decay to the `Descent` optimiser. The defaults of `ExpDecay` say that its learning rate will be decayed every 1000 steps.

0 commit comments

Comments
 (0)