We then did cross validation for the ODP tagger using gold dialog acts for training and automatically tagged dialog acts for testing.
for our best performing feature set so far, this reduced the F score from 65.8 to 52.7.