The reason is that we use two distinct and unrelated representations, left-context distributions to induce classes of predictees and right-context distributions to induce classes of predictors.
half-context models are inherently asymmetric, reflecting the fact that language models are inherently asymmetric: The role of the predictor and the predicted are different.