This division of labor also allows for differing amounts of human intervention both during training and in the interpretation of actions and bears some resemblance to (Andreas et al., 2016).
we will first present results where the model predicts a fixed semantic interpretation of actions which are easily human interpretable (Encoder + Representation).