mMiniBERT Effectiveness The multilingual baseline mMeta-LSTM does not do well on lowresource languages.
mMiniBERT performs well and outperforms the state-of-the-art Meta-LSTM on the POS tagging task and on four out of size languages of the Morphology task.