However, this soft-attention mechanism has the limitation that the softmax function always assigns small but non-zero probabilities to noisy clauses, which will weaken the attention given to the few truly significant clauses for a particular aspect.
besides, λ 1 , λ 2 are weight parameters.