This indicates that the inherent semantics of the proposed embeddings are meaningful enough as to require much less powerful learning architectures on top to perform downstream sequence labeling tasks.
for PoS tagging, the simple feedforward map is competitive to BiLSTM and much more effective to train.