Neural Network Cross Entropy Error To train a neural network you need some measure of error between computed outputs and the desired target outputs of the training data.