The traditional method has long been criticized for being "unsystematic, haphazard, and impos [ing] an impossible information-processing burden on the reviewer" (Hunter and Schmidt 1990, p. 488).
our recommendations thus apply only directly if authors use percentages to measure coder agreement.