Using the scoring function in Equation 7, we calculate the score of the sequence y normalised by the sum of scores of all possible sequencesỹ, and this becomes the probability of the true sequence: We train the model to maximise the probability of the gold label sequence with the following loss function: where p(y (n) |x (n) ) is calculated using the forward-backward algorithm.
as pointed out by  and Linzen et al.