We further compute an average human score: Inter-annotator agreement rates are computed in two ways.
unlike in their model, SAMSA stipulates that not only should multiple events evoked by a verb in the same sentence be avoided in a simplification, but penalizes sentences containing multiple events evoked by a lexical item of any category.