However, some related contexts are far from the response in the multi-turn dialogue generation task, and the RNN-based attention model may not perform well because it usually biases to the close contexts (Hochreiter et al., 2001), namely position bias problem.
how to effectively detect and use the relevant contexts remains a challenging problem in multi-turn dialogue generation.