Theoretical quantities like mutual information might seem appealing in this context given their strong grounding in information theory.
applying them would potentially require us to fully specify the state space the world can be in for an open-domain conversation, as well as estimating the probability distribution over potential configurations, neither of which is trivial, if feasible.