To answer this question, we create a variant, denoted woUttRNN, where attentional coefficients are applied directly to the token embeddings.
equation 4 is changed to equation 9: As seen in Tables 4 and 5, removing the utterance-level RNN (woUttRNN) reduces the accuracy and increases the negative log likelihood for the training, development and test partitions of both datasets.