Most of them are based on the co-occurrence information of words and their contexts.
note that in practice, one should nOT use DEPS context for POS-tagging and chunking tasks, since their labels are used in  parsing the source corpus.