These language vectors are trained end-to-end as part of neural models for downstream tasks such as many-to-one Neural Machine Translation (NMT).
language vectors can be obtained from artificial trainable tokens concatenated to every input sentence, similar to Johnson et al.