L = [l 1 , l 2 , ..., l 25 ] are the 25 golden aspect terms, where L (h) = [l 5h−4 , ..., l 5h ] are from the h-th human annotator.
the hard accuracy is defined as: counting the number of exact matches makes the accuracy score discrete and coarse.