In the present work, we focus on incorporating a decision-making module akin to an action selection policy into a visually-grounded encoder-decoder architecture and leave the integration of other more advanced dialogue management aspects for future work.
work on incremental dialogue processing, where a system needs to decide not only what to respond but also when to act (Rieser and Schlangen, 2011), has some similarities with the problem we address in the present paper, namely, when to stop asking questions to guess a target.