We notice that for a reasonably small adapter size, adapter performance gradually converges to its peak and stays steady, with almost no over-fitting for a long enough period, easing final model selection.
with full fine-tuning, optimal model selection becomes challenging due to rapid over-fitting on the adaptation corpus.