We use a neural network which consists of a weight matrix W 1 ∈ R n×n for left children and a weight matrix W 2 ∈ R n×n for right children to compute the vector for a parent node in a bottom up manner.
consider an example of head h and its dependents x, y (we ignore directions for simplicity) in Figure 5.