There is also recent work applying attentionbased models (Xu et al., 2015) on explicit object proposals (Anderson et al., 2018;Li et al., 2017), which may capture object-level information from the attention mechanism.
attention-based models require object information in the form of vectors, whereas our models use information of objects as categorical variables which allow for easy manipulation but are not compatible with the standard attention-based models.