However, despite its success, it remains unclear whether the representations produced by BERT can be utilized for tasks such as commonsense reasoning.
it is not clear whether BERT shed light on solving tasks such as the Pronoun Disambiguation Problem (PDP) and Winograd Schema Challenge (WSC).