The proposed model can be trained end-to-end by maximizing the conditional probability (3).
learning from scratch may not be informative for the separator and aggregator to disentangle the paraphrase patterns in an optimal way.