Many statistical machine translation systems such as IBM models (Brown et al., 1993) learn word translation probabilities from millions of parallel sentences which are mutual translations.
large scale parallel corpora rarely exist for most language pairs.