Here an invalid status indicates that agents have chosen a status that they are not supposed to reach according to Figure 2.
our self-play model is initialized using a model trained from the supervised learning.