Preliminary experiments found that simply transferring the lower-level weights of extractive QA models was ineffective, so we instead consider three methods of con-structing entailment-like data from extractive QA data.
in this paper, we gather a large number of additional yes/no questions in order to construct a dedicated yes/no QA dataset.