In this section, we describe how a notion of word order is included in the model through the integration of an n-gram language model.
equation 5can be represented as the product of two factors: where ∆ is the semantic component that scales p(w) in function of the context.