For example, words of similar semantic types, such as company -government, tend to come up as distributionally similar, even though they are not substitutable in a meaning preserving sense.
many semantic-oriented applications, such as Question Answering, Paraphrasing and Information Extraction, do need to recognize which words may substitute each other in a meaning preserving manner.