Such phenomenon reflects that our W2W model won't make a prediction recklessly on occasions where there is no clear addressee.
the variance on matching scores of all listeners in our W2W model, to some extent, provides a signal of whether the utterance has a explicit addressee even if we do not provide any supervision information on this aspect during training.