Aue and Gammon (2005) report a number of empirical tests into domain adaptation of sentiment classifiers using an ensemble of classifiers.
most of these tests were unable to outperform a simple baseline classifier that is trained using all labeled data for all domains.