The expected antecedent representation a i of each span i is computed by using the current antecedent distribution P (y i ) as an attention mechanism: The current span representation g i is then updated via interpolation with its expected antecedent representation a i : where is a learned gate vector.
the refined representation g i is an elementwise weighted average of the current span representation and its direct antecedents.