After each nextutterance token, our neural Drawer model is used to take an action in the scene and the resulting change in scene similarity metric is used as a reward.
this reward scheme alone has an issue: once all objects in the scene are described, any further messages will not result in a change in the scene and have a reward of zero.