For sentence fusion (Section 5.1), the input consists of two sentences, which sometimes need to be swapped.
the performance of the tagger is impaired significantly when leaving out the SWAP tag due to the model's inability to reconstruct 10.5% of the training set.