This is because the available training sets are small and using 20% of these samples as the development set means that the development set only contains a small number of samples.
the selected development sets are not proper representatives of the test sets and the tuning process results in overfitting the parameters (window sizes) to the development sets, with low generalization accuracy.