In this work, we use ReLu (Dahl et al., 2013) as the activation function; • w (1,j) is the parameters for the jth convolution unit on Layer-1, with matrix •ĉ i (0) is a vector constructed by concatenating word vectors in the k-sized sliding widow i; • b (1,j) is a bias term, with vector To distinguish the phrase pair from its context, we use one additional dimension in word embeddings: 1 for words in the phrase pair and 0 for the others.
they both extend the neural network joint model (NNJM) of Devlin et al.