Since the introduction of BERT, the NLP community continues to be impressed by the amount of ideas produced on top of this powerful language representation model.
we achieve 68.3% accuracy, better than the more recently reported results from (Liu et al., 2017) (66.7%), who makes use of three KBs and a supervised deep network.