The latter work makes use of translation and joint models, and pre-computes the first hidden layer beforehand, resulting in large speedups.
in comparison to the unidirectional word-based models, phrase-based models perform similarly.