We opt for an attention mechanism to reward segments that are more likely to be good sentiment predictors.
we measure the importance of each segment representation h ct through a scoring function using feed forward neural network as below: where W u ∈ R k×k , b u ∈ R k and v ∈ R k are trainable parameters, v can be seen as a high-level representation of a fixed query "what is the informative segment" like that used in (Yang et al., 2016).