We use an attention function to aggregate the representation of the salient words to form the bilingual attention vector v (bi) .
in the above equations, we first feed the bilingual word annotations h (Eq.