We concatenate the vocabularies of all source languages in the multilingual setting where special a "language marker " have been appended to each word so that there will be no embedding sharing on the surface form.
we avoid sharing the representation of words that have similar surface forms though with different meaning in various languages.