Turkers can  also choose "no preference" if the conversations are equally good or bad.
there is a strong demand to enable the integration of goals and strategy into opendomain dialogue systems, and it imposes challenges to both: first, how to define the goal for an open-domain chat system; and second, how to encode dialogue strategy into the response production process.