This means that a larger negative value does not automatically mean that there is a bad effect of this modality but solely that in conjunction with at least one better performing modality, the contribution to the overall result was moderate.
the reason why ASD values suffer if the negatively correlated modality gets stronger may be the result of the more effective ones getting weaker not necessarily because of a bad fit of the modality itself.