(Recall that, for training, CONTEXT uses instances in canonical form as being idiomatic and those in non-canonical form as being literal.)
in many cases, it is a priori more likely that a token is more similar to the K most similar canonical form instances.