While our experiments show a promising direction towards obtaining bilingual embeddings for CM tasks, there are several interesting ideas that are worth exploring.
the linguistic model used for generating artificial CM data only addresses the syntactic constraints of CM, but not other kinds of constraints such as lexical choice which in a particular CM context might be overly skewed towards one language (like the English words 'school' and 'vote' are more common than their Hindi translations in English-Hindi CM ), and semantic/pragmatic constraints that make the choice of a particular language more common in some contexts (e.g., Hindi used more commonly for negative sentiment during English-Hindi CM (Rudra et al., 2016)).