They use Stacked Denoising Auto-encoders (SDA) to induce a hidden representation that presumably works well across domains.
sDA is fully unsupervised and does not consider the end task we need to solve, i.e., the sentiment classification task.