However, without any constraints, the two feature spaces may both tend to pay more attention to frequently occurring and important sentiment words like great and happy, but less to those rarely occurring but crucial emotion words like anxiety and panic.
to encourage the two feature spaces to focus on sentiment words and emotionspecific words respectively, we propose using the attention weights computed from the shared layer as extra inputs to compute the attention weights of the target-specific layer.