Mathematics of Machine Learning

The Derivative of Softmax(z) Function w.r.t z

What will you learn? Ask any machine learning expert! They will all have to google the answer to this question: “What was the derivative of the Softmax function w.r.t (with respect to) its input again?” The reason behind this forgetfulness is that Softmax(z) is a tricky function, and people tend to forget the process of …

The Derivative of Softmax(z) Function w.r.t z Read More »