We follow the findings and design choices of GloVe and use a symmetric window of size win with a decreasing weighting function, so that word pairs that are d words apart contribute 1/d to the total count.
when the corpus is small (e.g., 17M, 32M, 64M) we let win = 15 and for larger corpora we let win = 10.