Among the other features, WV is still the most informative feature.
it does not dominate SSI, indicating the possibility for fine tuning the word embedding with prior knowledge (SSI in our case) as in (Faruqui et al., 2014).