Specifically, some annotators translate a "mostly yes" to a '3' while others translate it to a '2', and similarly for a "mostly no".
attributes that have fewer ambiguous cases (i.e., the '2' cases) tend to have a higher agreement.