By incorporating such an interpolation mechanism, we anticipate an amelioration in performance further supporting the use of half-context in language models.
but that is not possible in a whole-context model.