We use the weights, W , (see Figure 6) to form the weighted average: In the case of the weighted average for the embedding tensor, R, we use the weights from the next level.
when updating, each token "sees" information from tokens/entities on other levels dependent on whether or not they are in the same entity.