2013, we use accuracy (i.e., percentage of correctly labeled messages for binary polite/rude labels) to evaluate our politeness classifier's generalization ability.
we used data from the training set of WIKI, and test on both the test set of WIKI and the entire SE (Stack Exchange) corpus.