It allows to tune all the important settings so that the difference in performance could be attributed only to the difference in algorithms themselves, not to some peculiarities in preprocessing.
both types of models used symmetric window of 1 (only immediate left and right neighbors of words were considered) and no downsampling.