In order to evaluate model performance on the segment level, we constructed a new dataset named SPOT (as a shorthand for Segment POlariTy) by annotating documents from the Yelp'13 and IMDB collections.
we sampled reviews from each collection such that all document-level classes are represented uniformly, and the document lengths are representative of the respective corpus.