For each sentence, x is obtained by running the standard pre-trained ELMo on the UD token sequence (although UD's tokenization may not perfectly match that of ELMo's training data), and y is the labeled UD dependency parse without any part-of-speech (POS) tags.
our tags t are tuned to predict only the dependency relations in UD, and not the gold POS tags a also in UD.