We have shown that contextualized word representations perform generally better than static word embeddings on tasks related to lexical composition.
although they are on par with human performance in recognizing meaning shift, they are still far from that in revealing implicit meaning.