(2018)'s analysis of the effective context size of a word-based language model, we present an ablation study to measure performance when contextual information is removed.
when evaluating models, we retain only the characters in a small window around each time entity in the dev and test sets, and replace all other characters with padding characters.