When compared with DNorm and P-MT with GNews baselines, which are the most effective existing baselines, we observe that both CNN and RNN significantly (p < 0.05, paired t-test) outperform the two baselines for all of the three datasets.
the GNews embeddings benefit both CNN and RNN more than the BMC embeddings, which is in line with the previous finding that GNews is more useful than BMC for the EmbSim and P-MT baselines.