Hw 3 [1.4]

Any hints on why the limit as x (or o) approaches infinity is x (infinity) and why when it approaches -infinity the value is e^-x? If the loss is the log of the sigmoid function e^x / (e^x + e^-x) which ranges fro 0 to 1 then shouldnt the limit of the log loss be from -infinity to 0?

Here is the graph for log(1 / (1 + e^-x))

We should consider log(1+e^(-x)) not log(1 / 1+e^(-x))
The plot looks like a soft hinge loss:

1 Like