Another option is to combine the French and English datasets before extracting features.
we first replace the word-level transcripts with the sequence of information units, and then combine the two datasets and train the language models over the multilingual corpus, thus generating multilingual language models.