Formally, given the t-th parallel bilingual sentence C zh t , the bilingual context of w i is therefore To ensure efficiency, continuous bag-of-words (CBOW) model is applied, where it takes wordlevel input tokens and outputs sense-level identities.
given an English word embedding matrix P en , the local context can be modeled as the average of word embeddings from its context, 1 Similarly, we can model the bilingual contextual information given Chinese word embedding matrix P zh using the CBOW formulation and obtain 1 M w j ∈c i P zh j .