Due to the large number of discarded threads for a threshold of 3, we choose to adopt 2 as our threshold.
types that were assigned by at least two annotators are considered as gold standard, and are used to train machine learners, as described in the next section.