The third set is the entire αNLI development set introduced in Bhagavatula et al. (2020).
this indicates that naturally occurring examples in ChaosNLI-α are either highly certain or uncertain among human judgements.