This hidden layer essentially represents c 0,0 , c 0,1 , c 1,0 and c 1,1 , and it is used for the prediction of the relation between two words.
let w 1 , w 2 ∈ R d represent the entailment vectors corresponding to words w 1 and w 2 .