As we add data from ONEBWORD and α * decreases to 0.7, we find some positive transfer effects where the increased data from the ONEBWORD corpus improves the performance on Yelp.
as the fraction of nuisance data grows further and α * drops below 0.4 the MLE models suffer large increases in perplexity, incurring up to 10 additional points of perplexity.