We use softmax (Bishop, 1995) over the raw activation values as conditional probabilities, and also the score of the target.
suppose the number of classes is n, and the raw activation values of class i is act i .