Finally, pre-training models such as BERT (Devlin et al., 2018) can also be utilized for text matching.
the model is of high complexity and is hard to satisfy the speed requirement in real-world applications.