Our results confirm that the contextualized word embeddings perform better than the static ones.
we show that modeling context indeed contributes to recognizing meaning shift: On such tasks, contextualized models performed on par with humans.