Due to the normalization of the attention scores as described above, single attention cannot capture all relevant information needed to find the relation between two entities.
we use a multifactor attention mechanism, where the number of factors is a hyper-parameter, to gather all relevant information for identifying the relation.