First, for incorporating grandparent information (Figure 2.a), we expect σ t (j, i), which depends on the head vector of j and the dependent vector of i, not only considers the parent-child pair (j, i), but also consults the ("soft") parent of j suggested by the previous layer (denoted by k).
the new head representation of node j should examine representations of its neighbors when they act as parents of j.