We implement LSTM and Transformer machine translation models using OpenNMT-py 2 .
for the LSTM model, we train it with 453 thousand pairs from the Europarl corpus of German-English WMT 15 Task 3 , common crawl, and news-commentary.