They have already been applied by Bullinaria and Levy (2012) to a different set of tasks, including the TOEFL multiplechoice synonymy task.
bullinaria and Levy found that discarding the initial SVD dimensions (with highest variance) leads to substantial improvements, especially in the TOEFL task.