Meanwhile, to understand each of them requires understanding many action components (e.g., pouring a glass of milk is a complicated action sequence).
we hypothesize that it is beneficial to learn and align both the high-level (global) and low-level (local) temporal transitions of multiple modalities.