Outlined [here](http://neuralnetworksanddeeplearning.com/chap3.html#introducing_the_cross-entropy_cost_function) This intelligently learns quickly when the neural net is very wrong and slowly when the neural net is close to right.