(Tian et al., 2017) proposed a weighted sequence (WSeq) attention model for HRED, using the cosine similarity to measure the degree of the relevance.
they first calculate the cosine similarity between the post embedding and each context sentence embedding, and then use this normalized similarity score as the attention weight.