If the interpretation is faithful, then the curve will drop rapidly, resulting in a small area under a curve (AUC).
replacing the token with zero or removing it from a sentence can cause the OOD problem again.