One thing to note is that, our objective function is not differentiable because of the loss function l( x n , y n , Θ).
we use sub-gradients for l( x n , y n , Θ) instead, which can be computed by the formula: where ŷ is the predicted label sequence which corresponds to l( x n , y n , Θ).