The contributions of this work are as follows: • We extend the LSTM model to higher order models.
the performance of the high order models which are supposed to capture longer tag dependencies is getting worse when increasing the order.