Next, to further fuse representations distilled by the bi-attention on each encoder, we design a merge layer, a multilayer perceptron (MLP) activated by hyperbolic function: where Note that either v p or v c conveys the information from both posts and conversations, but with a different emphasis.
v p mainly retains the contexts of posts with the auxiliary information from conversations, while v c does the opposite.