1 The increased parameter sharing ability of such models is especially relevant for learning embeddings of rare and unseen words.
the importance of subword-level knowledge should be even more pronounced in low-data regimes for truly low-resource languages.