In addition, we examine how gender bias in ELMo propagates to the downstream applications.
we evaluate a state-of-the-art coreference resolution system  that makes use of ELMo's contextual embeddings on WinoBias (Zhao et al., 2018a), a coreference diagnostic dataset that evaluates whether systems behave differently on decisions involving male and female entities of stereotyped or anti-stereotyped occupations.