The learning rate is one of the most important hyper-parameters to tune for training deep neural networks. In this post, I’m describing a simple and powerful way to find a reasonable learning rate…
