Supposed the data has maximal m turns and n candidates, the time complexity of crossattention (Zhou et al., 2018), O(mn), is much higher than that of the Dual-Encoder based model, O(m + n).
cross-attention is an impractical operation when the candidate set is large.