Despite the Qualifications and other measures taken in the collection phase of the corpus, we believe the quality of the data remains open to question.
the Mechanical Turk framework provided additional information for each assignment, for example the time workers spent on the task.