Even tri-gram model suffers from sparse-data estimation problem, but various smoothing techniques (Goodman, 2001) have led to significant improvements in many applications.
lSA is better at predicting topic bearing content words while parsing based models are better for function words.