The Stochastic Delta Rule: Faster and More Accurate Deep Learning through Adaptive Weight Noise.

Multilayer neural networks have led to remarkable performance on many kinds of benchmark tasks in text, speech, and image processing. Nonlinear parameter estimation in hierarchical models is known ...