where ⊕ indicates concatenation, s t and m t are respectively a hidden state and a memory cell at time t, and e 1 (word ) is embedding of word.
we consider it is because various types of deletion make the compression model more flexible, as indicated by closer CR of the model trained on multi-root+ instead of rooted to the average CR of the test data.