Here, we experiment with a shifted additive model obtained by subtracting a constant vector from the summed PMI vector.
we obtained shifted vectors by computing, for each dimension, the average deviation from the additive model in the training data.