Whereas, by intuition, many high-frequency functional words would not be helpful to the estimation of the similarity given in Eq.(2).
in the preprocessing stage, we compute the word frequencies per dataset, and then remove the high frequency words (top 1% in frequency list) in each segment.