Accurately representing synonymy using distributional similarity requires large volumes of data to reliably represent infrequent words.
the naïve nearestneighbour approach to comparing context vectors extracted from large corpora scales poorly (O(n 2) in the vocabulary size).