The bidirectional LSTM layer is essential to extract character, word, and contextual information from a sentence.
with a large number of parameters, it cannot be fully trained only using the low-resource task data.