The number of contextual sentences positively supporting a relational fact is also an important signal, but is lost in mean pooling.
instead, we use summation with a trainable cap: we additively aggregate the signals from all the contextual sentences, but only to a bounded degree.