Which optimizer and learning rate should I use for deep learning?

To better understand the affect of optimizer and learning rate choice, I trained the same model 500 times. The results show that the right hyper-parameters are crucial to training success, yet can be hard to find.

Read the full article

April 9, 2018