One possible way to alleviate this problem is to also leverage the soft-attention mechanism as proposed in .
this soft-attention mechanism may induce additional noise and lack interpretability because it tends to assign higher weights to some domain-specific words rather than real sentiment-relevant words (Mudinas et al., 2012;Zou et al., 2018).