It is acceptable that when using more complicated language models, the effect of visual knowledge will be weakened.
there are indeed some methods to improve the current results, which will be investigated in our future work.