We use a fully connected layer with 1024 ReLU hidden units as our answer generator.
alent to the last visual "attention map" although there isn't explicit visual attention in our imagecomprehension pipeline).