Initially some of the data was annotated using a crowd-sourcing platform which required the number of slots filled per task to be fixed.
we picked the minimum number of turns that we thought sufficient to make a decision whether turn S3 would be an appropriate system answer or not.