James McCaffrey explains the common neural network training technique known as the back-propagation algorithm.

The standard “back-propagation” training technique for deep neural networks requires matrix multiplication, an ideal workload for GPUs. With SLIDE, Shrivastava, Chen and Medini turned neural network ...

In this work, a gradient method with momentum for BP neural networks is considered. The momentum coefficient is chosen in an adaptive manner to accelerate and stabilize the learning procedure of the ...

Back Propagation is a common method of training artificial neural networks so as to minimize objective function. This paper describes the implementation of back propagation algorithm.

The challenge of speeding up AI systems typically means adding more processing elements and pruning the algorithms, but those approaches aren’t the only path forward. Almost all commercial machine ...