It is not surprising that rare co-occurrence words that occur only in long range contexts may have almost no correlation between them.
treating them as negative samples will not create a problem in most cases.