To test machine for human-level intelligence, we leverage a state-of-the-art natural language generator GPT2 (Radford et al., 2019) to automatically generate an answer by reading the given paragraph and question.
we fine-tune a pre-trained GPT2 language model on all the ⇥ Paragraph, Question, Correct Answer ⇤ of COSMOS training set, then given each ⇥ Paragraph, Question ⇤ from test set, we use GPT2-FT to generate a plausible answer.