One reason might be: despite the measures are empirically proved to reflect generalization, they are only one view towards generalization respectively.
in recent generalization theory (Novak et al., 2018;Bartlett et al., 2017), the measures are evaluated between models with extremely evident difference in generalization ability (measured by test performance difference), for example, between models trained with random labels and true labels.