Following the above definition, the sequence of the highlight embedding is of the same length as d. We replace d with 3.4 Self-Assessment (SA) While in previous work (Radford et al., 2018), the original GPT is directly fine-tuned on an MRC end task, we instead develop a fine-tuning approach inspired by the self-assessment reading strategy.
we propose a simple method to generate questions and their associated multiple spanbased answer options, which cover the content of multiple sentences from a reference document.