Evaluating with adjusted perplexity showed that a background model interpolated with a user-only model performs well when larger amounts of user-specific text are available.
neural background interpolated with either user-only model outperforms all other models when using 10k tokens or more of the user's text.