The uniform distribution is appropriate in our setup, since annotators are not told which system generated each output, and the order of choices is randomized.
to statistical tests such as χ 2 , or the G 2 Log Likelihood Ratio, Fisher's Exact Test produces accurate p-values even when the expected counts are small (as is extremely common in our case).