of the models are indeed different, and that the features encoded by TEXTUAL are more associated with syntactic constructions than in the case of VISUAL.
when comparing LM with TEXTUAL, the difference between context types is much less pronounced, with distributions overlapping.