In countries that speak multiple main languages, mixing up different languages within a conversation is commonly called codeswitching.
from the left image of figure 2, in word-level, the model mostly chooses the correct language embedding for each word, but also combines with different languages.