This decrease is likely due to the fact that AIDA-light was last updated in 2014 while the CNN/DailyMail datasets contain articles collected until the end of April 2015.
the default approach we use is to concatenate the claim and context into a linear sequence of tokens during preprocessing (shown in Figure 4a).