We start with 2000 non-zero entries in the covariance matrices and experiment up to 20,000 non-zero entries.
absolute thresholding tends to remove all the less frequent word pairs while leaving the cooccurrences of the frequent words untouched.