In this paper, we formulate phrase grounding as a sequence labeling task where we treat candidate regions as potential labels, and use neural chain Conditional Random Fields (CRFs) to model dependencies among regions for adjacent mentions.
to standard sequence labeling tasks, the phrase grounding task is defined such that there may be multiple correct candidate regions.