In recent years, video semantic comprehension has attracted much research attention, with a number of datasets and tasks being proposed such as activity recognition (Xu et al., 2017), dense video captioning (Krishna et al., 2017a), visual question answering (Lei et al., 2018(Lei et al., , 2019 etc.
most works are limited to only capturing coarse semantic information such as action recognition in broad categories.