To mimic this setup, we condition our question generation at round t only on the partial scene graph S t q that accumulates information received so far from the dialog history (and not on S a ).
we use a set of caption {T C i } and question {T Q i } templates (enumerated in Tab.