This phenomena has already been studied in script learning works (Chatman, 1980;Chambers and Jurafsky, 2008b;Ferraro and Van Durme, 2016;Pichotta and Mooney, 2016a;Peng and Roth, 2016).
modeling actions is not sufficient; participants in actions and their emotions are also important.