We propose instead to combine benefits from differentiable sampling and bi-directional NMT to obtain a compact model that can be trained endto-end with back-propagation.
• Translations are sampled using the Straight-Through Gumbel Softmax (STGS) estimator (Jang et al., 2017;Bengio et al., 2013), which allows back-propagating reconstruction errors.