Learning Rate: The One Number That Can Make or Break Your Entire Model

Too small and you'll wait forever. Too big and you'll explode. The learning rate is the most important hyperparameter in deep learning — and most beginners get it completely wrong.