Both some of the internal neurons of the memory cell in the language model and the sentiment model emerge to be sensitive to the length of the input sequence, as we expected, since the sentence length is a non-linguistic features shared by all the sequential input.
different optimization objectives force the models to represent and capture the linguistic properties of different aspects.