Although pattern-based approaches such as LRA have achieved promising results in some semantic relational tasks (Turney, 2008a,b), they have a crucial problem that a co-occurrence of all semantically related word pairs cannot be observed because of Zipf's law, which states that the frequency distribution of words has a long tail.
most words occur very rarely (Hanks, 2009).