Additionally, since TagLM (Peters et al., 2017) with one-layer NNs can be viewed as a special case of ELMo, we also include its results.
models marked with † employed LSTms with projection, which is more efficient than the vanilla LSTms.