Our English-Spanish models show a similar behaviour to the one observed for the English-Italian pair.
while the original XLM operates on streams of text, split by sentence separators, we split the stream of tweets, so that each example contains only one tweet.