As seen, the proposed approach indeed pays more attention to the most recent history (e.g., the leftmost positions) in all domains.
the larger the cache, the more attention the model pays to the most recent history.