Only with LM pretraining, the zero-shot NMT has already closed the gap between the performance and that of the strong pivot-based baseline for datasets.
then, En tokens starts to appear in the output sentence of ZS, and it totally shifts to En eventually.