BERT also requires special processing due to the length constraint; please refer to the supplementary material for details.
we focus on presenting LSTM with attention in the main paper for ease of understanding.