Our extraction methodology is 5 Nouns and verbs were identified by mapping the fine-grained part-of-speech tag to its coarse-grained category (Petrov et al., 2012): https://github.
com/slavpetrov/universal-pos-tags/blob/ master/en-ptb.map 6 We excluded VBN from the set of verb tags, as it often functions more similarly to non-verbs 7 non-sentence initial tokens 8 Labeled as amod according to a dependency parser 9 Labeled as nn according to a dependency parser Agreement Type # % Unanimous 23,908 71.4% Majority 9,122 27.3% Disagreement 432 1.3% Table 4: Inter-annotator agreement rates.