Different from the previous study that modeled the difficulties of instances and the user's authority (Whitehill et al., 2009), we target at integrating multiple labels for each instance by estimating the matching degree of documents and annotators.
our work is applicable to aggregating individual sentiment labels in social media, where users under various scenarios (e.g., character and preference) may express invalid or noisy sentiments to different topics.