Formally, we define the probability of the model choosing the correct sequence S 1 over spurious sequences as the softmax over the lengthnormalized log probabilities of all plausible sequences: where T i refers to the length of the text sequence S i .
we can practically minimize the negative log-likelihood of Eq.