We propose constrained attention networks for multi-aspect sentiment analysis, which handles multiple aspects of a sentence simultaneously.
we introduce orthogonal and sparse regularizations on attention weights.