To alleviate the above issue, we propose a model for multi-aspect sentiment analysis, which regularizes the attention by handling multiple aspects of a sentence simultaneously.
we introduce orthogonal regularization for attention weights among multiple non-overlapping as-pects.