With the LSTM-RNN model, the tanh function, in general, worked best whereas the sigmoid function was the worst.
positive, negative, or neutral) is available, we put a softmax layer (see Equation 1) to compute the probability of assigning a class to it.