The derivatives with respect to the hidden activation of position i at the last time step T are computed as follow: where v i represents the weights of hidden-output connection and the activation of the output layer y is used to estimate probability of the tweet bearing a particular polarity.
this is due to the fact that tuned embeddings capture the sentiment information of text by distinguishing words with opposite sentiment polarities and providing more flexibility for composing.