One way to evaluate this is by decreasing the lexical similarity between premise and hypothesis.
biLSTM-based models show significant proportion of correctly classified samples without even looking at the premise (which is an undesirable behavior).