Skip to content

Commit c9b5bac

Browse files
committed
suggest adding network noise as an optional exercise
1 parent ca599e2 commit c9b5bac

File tree

1 file changed

+2
-0
lines changed
  • content/assignments/Assignment_1:Hopfield_Networks

1 file changed

+2
-0
lines changed

content/assignments/Assignment_1:Hopfield_Networks/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,8 @@ Here, $S_i \in \{-1, +1\}$ is the current state of neuron $i$. To "retrieve" a
5454
- Continue looping until either (a) you have "updated" every neuron in the latest loop, but no activities have changed, or (b) a maximum number of iterations is reached.
5555
- Return the current state of the network as the retrieved memory.
5656

57+
Optional: instead of always following the update rule, add "noise" to the network by (in a very small proportion of updates) randomly flipping the neuron's activity. This can sometimes improve a network's performance by "kicking" the network out of local minima! It can be instructive to explore a network's performance with vs. without noise, and/or as a function of how much noise is being added.
58+
5759
---
5860

5961
### 2. Test with a Small Network

0 commit comments

Comments
 (0)