To gain more insight into what information LSTMs base their decisions on, we propose a generalisation of Contextual Decomposition (GCD).
this setup enables us to accurately distil which part of a prediction stems from semantic heuristics, which part truly emanates from syntactic cues and which part arise from the model biases themselves instead.