Our goal is to investigate the effect of contextual features such as the length of context, word order and more, on LSTM performance.
we use ablation analysis, during evaluation, to measure changes in model performance in the absence of certain contextual information.