In the case of code-switched social media data, we require a pertoken language variable.
training of polylingual topic models requires parallel or comparable corpora: document tuples from multiple languages that discuss the same topic.