The confidence intervals are calculated using the Binomial Exact Test (Agresti 1990  Without SVD (compare column 1 to 2 in Table 17), performance drops, but the drop is not statistically significant with 95% confidence, according to the Fisher Exact Test (Agresti 1990).
we hypothesize that the drop in performance would be significant with a larger set of word pairs.