It is because the OOV issue is not severe for the char-based model and thus does not affect the performance much.
as we remove more and more training examples, the shrinking training dataset creates a bigger problem.