To avoid this problem, the exponential decay approach proposed in (Clarkson and Robinson, 1997) has been adopted to express the distance of contextual words from the current word.
the bag-of-words vector with decay weights can be defined as following: where i, k Positions of the current word and words within the BoW model respectively.