We do so by systematically examining threats to the validity of experiments involving recent CSR models.
when evaluating on SwAG, it is important to determine whether the prediction relies on an understanding of the context or on shallow patterns in the LM-generated counterfactuals.