From the agreement judgments, we created the agreement matrix AM , which contains one column per assertion, and one row per participant.
each cell ad p,a in this matrix has the judgment provided by participant p for assertion a. ad a is the vector of all judgments provided for assertion a, and ad p is the vector of all judgments provided by participant p. To obtain consistent and comparable fine-grained scores indicating the degree of support or opposition from multiple respondents, we used a technique known as Best-Worst Scaling (BWS) (Louviere et al., 2015b).