Our evaluation set is therefore not from the same distribution as our training set.
since our goal is to produce good general conversation responses, we found it to be a good general purpose evaluation set.