Most existing methods in comparable corpora mining introduce two encoders to represent sentences of two languages separately, and then use another network to measure the similarity (Chu et al., 2016;Grover and Mitra, 2017;Grégoire and Langlais, 2018).
owing to the shared encoders and decoders in language modeling, the semantic spaces of two languages are already strongly connected in our scenario.