7.3 : so we ship one 7.4 : boxcar 7.5 : of oranges to Elmira 7.6 : and that takes another 2 hours Previous studies of discourse deixis annotation showed that these are extremely difficult judgments to make (Eckert and Strube 2000;Navarretta 2000;Byron 2002), except perhaps for identifying the type of object (Poesio and Modjeska 2005), so we simplified the task by only requiring our participants to identify the boundaries of the area of text in which the antecedent was introduced.
for example, it assumes that units may not overlap in a single coder's output, yet in practice there are many The difference between overlapping units is d(A, B) = s 2 − + s 2 + (adapted from Krippendorff 1995, figure 4, page 61).