This test set contains English transcriptions of 12 TED conference talks (and their French translations), selected in such a way that the texts include a reasonable number of instances of some less frequent pronoun types.
previous approaches to pronoun translation evaluation include the automatic precision/recall-based measure of Hardmeier and Federico (2010), the (manual) pronoun selection task used in the DiscoMT 2015 shared task evaluation (Hardmeier et al., 2015) and methods based on manual counting (Le Nagard and Koehn, 2010;Guillou, 2012;Novák et al., 2013).