By learning word embeddings and composition matrices on more data, the model is likely to generalise better.
for the more complex models, where the composition functions are conditioned on various CCG parameters, this should Training Model Regular Pretraining CCAE-A 77.8 79.5 CCAE-B 76.9 79.8 CCAE-C 77.1 81.0 CCAE-D 76.9 79.7 Table 4: Effect of pretraining on model performance on the SP dataset.