The information of POS tag generally improves the performance for the cases of longer sentences.
the GRU512 model on word-level with POS tag outperforms other models for the sentences of lengths ≥ 4 words.