This distributional approach works under the assumption that the context vector of each word encodes sufficient information for enabling accurate word clustering.
many words are distributionally unreliable: due to data sparseness, they occur infrequently and hence their context vectors do not capture reliable statistical information.