One might hypothesize that our gains come from exploit-  ing the English half of the corpus as an additional language model resource.
we explore transfer learning for the child model with parent models that only use the English side of the French-English corpus.