For example, some erroneous word combinations may not be completely devoid of compositional meaning, while violating language conventions.
semantic models might still be able to capture some of these conventions.