There are some examples in MNLI that contradict the heuristics in ways that are not easily explained away by other heuristics; see Appendix A for examples.
such cases are likely too rare to discourage a model from learning these heuristics.