Recently, a model combining both topdown and bottom-up attention reaches the winner of multiple challenges (Anderson et al., 2018).
how to combine the top-down and bottomup attentions effectively is still an unexplored problem in the vision-and-language tasks.