It has been shown that non-native language and translations are closer to each other than they are to the native language (Rabinovich et al., 2016).
this difference in accuracy cannot necessarily be attributed to the embeddings but more likely to the input labels.