There is strong evidence that competition and ranking of these constraints is important to achieve an optimal interpretation.
we have developed an optimization approach for multimodal interpretation, particularly for interpreting multimodal references.