The joint model presented in this paper differs in a number of key aspects: we use a recurrent architecture representing an unbounded history of both source and target words, rather than a feedforward style network.
3 if the context is large, then the amount of recombination will decrease significantly, leading to less variety in the decoder beam.