Recently, bi-LSTMs have achieved high accuracies in a simpler sequence labeling task: partof-speech tagging (Wang et al., 2015;Ling et al., 2015) on the Penn treebank, with small improvements over local models.
we achieve strong accuracies compared to (Wang et al., 2015) using feed-forward neural network model trained on local context, showing that this task does not require bi-LSTMs.