Once these models are trained, they are used to produce the 4000 sentence embeddings that will serve as training input to the classifier (and the 1000 sentence embeddings used for testing).
for these tasks-as long as vocabulary words are not out-ofvocabulary for the models (which we confirm below)-the important thing should be not what the words themselves are, but whether dependencies between them have been captured in the sentence embeddings.