The English training data is tokenized and lowercased using scripts in Moses (Koehn et al., 2007).
the decoder can then use the topic knowledge of previous translated words to increase the likelihood of selecting words from the same topic.