We also test the REINFORCE policy gradient algorithm (Williams, 1992).
most measures of coreference resolution performance do not decompose over local decisions, which means the utility of a particular decision is not known until all other decisions have been made.