The drawback to the binary model is that the probabilities assigned to the candidate speakers do not need to directly compete against each other.
when assigning a binary probability to a candidate speaker, the classifier does not take into account how good the other candidate speakers are.