Most language models approximate this via an n-gram probability for a fixed context window of length n − 1, instead of taking the entire sentence so far.
using the language model score is ineffective for two reasons.