As shown in Kim et al. (2020), such a sequential way can better simulate a multi-turn dialog and facilitate knowledge selection in later turns.
we thus devise the disentangled variant as following, where the roles of two types of information are separated, which makes it feasible to conduct ablation study.