If there was a disagreement about the sentiment of a specific word, the collective judgment after discussion was used as a final ground truth.
of our assessment procedure we had obtained the list of 4079 sentiment words in the movie domain.