been regarded as the de facto standard evaluation benchmark for subword and rare word representation techniques.
our analysis shows that RW suffers from multiple issues: (1) skewed distribution of the scores, (2) low-quality and inconsistent scores, and as a consequence, (3) low inter-annotator agreement.