Strong indications of perspective can often come from collocations of arbitrary length; for example, someone writing get the government out of my X is typically expressing a conservative rather than progressive viewpoint.
going beyond unigram or bigram features in perspective classification gives rise to problems of data sparsity.