Because these two LMs tightly integrate the word information jointly with the tag distribution, the trigram information is already represented.
the cSuperARV LM and Chelba's and Charniak's parserbased LMs have much lower correlations, indicating they have much lower overlap with the trigram.