The attention vector is obtained as a weighted sum of γ d,t : Finally, the output layer receives the concatenated vector of H i and Ω i : The training updates the parameters to maximize both the label probability and 1st-order attention distribution α 1,k,l .
we use the following loss function for optimization: In this equation, E k,i is 1 if the edge from x k to x i exists in the training instance.