The average correlation of the annotators was 0.59 while the average correlation with the final average ratings was 0.8.
• As the dataset was intended to test language models, each word should be translated into one word.