; 4. part-of-speech tags, automatically generated with the Tree-Tagger (Schmid, 1995) and manually corrected; 5. lemmata, automatically generated with the Tree-Tagger and manually corrected; 6. the information which object is moved and where it is moved to (manually annotated); 7. the information whether the left or right hand touches a particular object (manually annotated); 8. the information whether a particular object touches the ground/table (automatically identified by the object tracker and manually corrected); 9. segmentation of the stream of words into chunks using heuristics such as long pauses (min.
the overall goal of the data collection activity was to gather multimodal data of basic actions such as tAKE (Ge: nehmen), PUt (Ge: stellen/legen) and PUSH (Ge: schieben).