To address these issues and also to understand the range of possible interactions between humans and objects, the human-object interaction (HOI) detection task has been proposed, in which all possible interactions between a human and a given object have to be identified (Le et al., 2014;Chao et al., 2015;Lu et al., 2016).
both action classification and HOI detection do not consider the ambiguity that arises when verbs are used as labels, e.g., the verb play has multiple meanings in different contexts.