Although potentially useful information on word relationships is hidden in their internal subwordlevel structure, 1 subword-agnostic word representation models do not take these structure features into account and are effectively unable to represent rare words accurately, or unseen words at all.
there has been a surge of interest in subword-informed word representation architectures aiming to address these gaps.