In (Axelrod et al., 2011;Duh et al., 2013), the sizes of the in-domain data sets are 30K and over 100K sentences respectively.
we do not always have access to large or even medium amounts of in-domain data.