Later versions of PTMiner include a final filtering stage to clean the extracted corpus; Nie and Cai (2001) independently used features similar to those described here to eliminate noisy pairs.
16 Step 3 is potentially tricky owing to computational complexity issues.