A Fresh Look at Nonlinearity in Deep Learning | Towards Data Science

The traditional reasoning behind why we need nonlinear activation functions is only one dimension of this story.