The agreement between experts and non-experts is lower than the agreement between just experts or just non-experts, which may be due to the difference of these experimental settings for experts (Grundkiewicz et al., 2015) and for non-experts (this work).
this finding is not overly concerning since the correlation between the rankings is so strong.