In order to bridge the gap, we propose to learn a separate transform from the foreign words to an encoding of the reference target words, thus making the source-side representations look more like the target-side encodings used in the oracle experiment.
we learn a linear transform d θ : x → r mapping directly from a vector encoding of the foreign sentence x to an l-dimensional LSA representation r of the reference sentence.