Before continuing the discussion, we note that we found that adjacent documents in the CoNLL03 and the MUC7 datasets often discuss the same entities.
we ignore document boundaries and analyze global dependencies in 200 and 1000 token windows.