Although we do want tag t i to consider context-e.g., to distinguish between noun and verb uses of word i-we want "most" of t i 's information to come from word i itself.
it should come from ELMo's level-0 embedding of word i, denoted byx i -a word type embedding that does not depend on context.