Considering only the 16-word subset with both S and O senses (according to Judge 1), κ is .75, and for the 16-word subset for which Judge 1 gave only S or only O senses, κ is .73.
table 1 shows the contingency table for the two annotators' judgments on this data.