2), the "Saarbrücken Corpus of Textually Annotated Cooking Scenes" (TACOS).
the TACOS corpus provides: • A collection of coherent textual descriptions for video recordings of activities of medium complexity, as as a basis for empirical discourse-related research, e.g., the selection and granularity of action descriptions in context • A high-quality alignment of sentences with video segments, supporting the grounding of action descriptions in visual information • Collections of paraphrases describing the same scene, which result as a by-product from the text-video alignment and can be useful for text generation from videos (among other things) • The alignment of textual activity descriptions with sequences of low-level activities, which may be used to study the decomposition of action verbs into basic activity predicates We expect that our corpus will encourage and enable future work on various topics in natural language and video processing.