Since in log-linear models, the model scores are not normalized to form probability distributions, the scores that different models assign to each phrasepair may not be in the same scale.
mixing their scores might wash out the information in one (or some) of the models.