Given our inclusion of the entire dictionary of words and the absence of reliable language labels, we wish to understand how the model performs on uncommon words and sentences.
we rank each word in the dictionary by its frequency over the training set, as a proxy for belonging to highor low-resource languages.