Not only do we want to test whether the crowd can achieve the same quality of annotation for such a complex task, but also whether the crowd annotation preserves the compositionality of the perspective for complex constructions, possibly including double negations or nested perspectives.
does the crowd read the text in the same way as experts do?