These metrics have recently been adopted by dialogue researchers (Ritter et al., 2011;Li et al., 2015;Galley et al., 2015b;Wen et al., 2015;Li et al., 2016).
these metrics assume that valid responses have significant word overlap with the ground truth responses.