Among all the features used, only a few might be very relevant to recognizing the non-compositionality of the MWE.
the distance metric used by the nearest-neighbour algorithm which depends on all the features might be misleading.