We find this simple scheme remarkably effective: it is able to outperform pretagging and can operate even in the absence of word embeddings.
its performance is ultimately not quite as good as using a character LSTM.