Parameter choice: we experiment with higher learning rates coupled with larger window sizes.
the model should take the risk of a) overshooting a minimum error; b) greedily considering irrelevant contexts in order to increase its chance to learn anything.