Past work requires these constraints and the HSMM, when trained without them, does poorly, learning to capture diversity across videos rather than to identify steps.
a given step for a task can occur multiple times, or not at all, in any of the task's videos.