A Gentle 101 Talk on Artificial Neural Networks
What is this post about? In this super gentle 101 talk given at the Insight Centre for Data Analytics at University College Dublin , I…
Tag: deeplearning
The Backpropagation Algorithm-PART(1): MLP and Sigmoid
What is this post about? The training process of deep Artificial Neural Networks (ANNs) is based on the backpropagation algorithm. Starting with this post, and…
Dissecting Relu: A desceptively simple activation function
What is this post about? This is what you will be able to generate and understand by the end of this post. This is the…
An interview with Prof. Mikhail Belkin
We never Had Truly Understood the Bias-Variance Trade-off!!! In this interview with Prof. Mikhail Belkin, we will discuss his amazing paper: “Reconciling modern machine learning…
Reconciling modern machine learning practice and the bias-variance trade-off
What is This post about? The interview with the lead author of the paper: Prof. Mikhail Belkin Together we will analyze an amazing paper entitled:…
An interview with Prof. Tom Mitchell
“There are a lot more papers written than there are widely read!” (Tom Mitchell) Prof. Tom Mitchell is one of the giants of machine learning…
Back-propagation with Cross-Entropy and Softmax
What will you learn? This post is also available to you in this video, should you be interested 😉 https://www.youtube.com/watch?v=znqbtL0fRA0&feature=youtu.be In our previous post, we…
The Derivative of Softmax(z) Function w.r.t z
What will you learn? Ask any machine learning expert! They will all have to google the answer to this question: “What was the derivative of…
What is the Delta Rule? (Part-2)
What We Have Learned So Far … So far, we have learned that the Delta rule guarantees to converge to a model that fits our…