The approach we take in this paper leverages the fact that the speech signal in instructional videos is often closely related to the actions that the person is performing (which is not true in more general videos).
we first align the instructional steps to the speech signal using an HMM, and then refine this alignment by using a state of the art computer vision system.