In our example, the training data will now consist of following instances: (<w> implies embedding of the English word w to which the in-language word has been translated) Now the word vectors are initialized as before and the network is trained as usual on this extended training data (Figure 1c).
when the labeled dataset is small in size, as is often the case in most languages, this problem adversely affects the classification performance.