We propose a general framework for learning subword-informed word representations that allows for easy experimentation with different segmentation and composition components, also including more advanced techniques based on position embeddings and self-attention.
sms is less useful for entity typing, where almost all best-performing configurations are based on morf (see also Figure 4).