Our main goal is to study how different output layers affect the training speed and performance, which cannot be achieved by just comparing ELMO-C and ELMO, due to the aforementioned minor changes to ELMO-C.
we introduce two additional baseline models (ELMO-A and ELMO-Sub), which differ from ELMO-C in a minimal way.