The experiments presented here demonstrate that the performance of a simple baseline model can be improved significantly if long-range dependencies are also captured.
our results indicate that it is important not to restrict the model to local dependencies.