@@ -81,31 +81,40 @@ Saying it is `3` is the arguably the nicest, but it is also the most expensive t
81
81
plot(ceil)
82
82
```
83
83
84
- Here it seems most useful to say the derivative is zero everywhere.
84
+ Here it is most useful to say the derivative is zero everywhere.
85
85
The limits are zero from both sides.
86
86
87
- The other option for ` ceil ` would be to say it is 1 everywhere.
87
+ The other option for ` x-> ceil(x) ` would be relax the problem into ` x->x ` , and thus say it is 1 everywhere
88
88
But that it too weird, if the use wanted a relaxation of the problem then they would provide one.
89
- Imposing one on ` ceil ` for everyone is not reasonable.
89
+ We can not be imposing that relaxation on to ` ceil ` for everyone is not reasonable.
90
90
91
91
### Primal finite, and derivative nonfinite and same on both sides
92
92
93
93
``` @example nondiff
94
94
plot(cbrt)
95
95
```
96
- s(derivative nonfinite and different on each side is not possible with a finite and defined primal.)
97
- ### Primal and derivative Non-finite and same on both sides
96
+
97
+
98
+
99
+ ### Primal and derivative Non-finite and different on both sides
98
100
``` @example nondiff
99
101
plot(x->inv(x^2))
100
102
plot!(; xlims=(-1,1), ylims=(-100,100)) #hide
101
103
```
102
104
103
- ### Primal and gradient Non-finite and differing on both sides
105
+ In this case the primal isn't finite, so the value of the derivative can be assumed to matter less.
106
+ It is not surprising to see a nonfinite gradient for nonfinite primal.
107
+ So it is fine to have a the gradient being nonfinite.
108
+
109
+ ## Primal finite and derivative nonfinite and different on each side
104
110
``` @example nondiff
105
- plot(inv)
106
- plot!(; xlims=(-1,1), ylims=(-100,100)) #hide
111
+ plot(x-> sign(x) * cbrt(x))
107
112
```
108
113
114
+ In this example, the primal is defined and finite, so we would like a derivative to defined.
115
+ We are back in the case of a local minimal like we were for ` abs ` .
116
+ We can make most of the same arguments as we made there to justify saying the derivative is zero.
117
+
109
118
### Not defined on one-side
110
119
``` @example nondiff
111
120
plot(x->exp(2log(x)))
@@ -127,6 +136,8 @@ Also nice in this case is that it agrees with the symbolic simplification of `x-
127
136
plot(log)
128
137
```
129
138
139
+ Here there is no harm in taking the value on the defined, finite
140
+
130
141
### sub/super-differential convention
131
142
** TODO: Incorperate this with rest of the document. Or move to design notes**
132
143
0 commit comments