We see one potential problem out of the above method: it can only be applied to a certain group of examples and imply a general model behavior by examining the prediction imbalance.
furthermore, we develop a new quantitative measure based on influence functions that can reveal artifacts in training data.