The authors did not specify training and smoothing of their model, so we only adopt their definition of the context window, and use the same neural network architecture as for our other models.
we use two neural networks: one for left dependents, and one for right dependents.