The Upper Bound in the Induced column of these tables represents a perfect labeling of the most accurate induced binary tree from DIORA, and the Majority (NP) row is the same tree labeled with the most common tag.
while ELMo (Peters et al., 2018a) and BERT (Devlin et al., 2019) do not produce phrase vectors or induce recognizable constituency parse structure, 3 we show that they can still be used for unsu- 3 BERT does not strictly output word-level vectors.