Such word re-ordering knowledge is indeed learnable (Ma et al., 2018), and does not necessarily contain the syntactic information.
the multi-task and adversarial losses for syntax and semantics do not suffice to regularize DSS-VAE.