Like bag-of-walks kernels, their kernel takes multi-word co-occurrences with a target word into account, but these co-occurrences are taken in terms of (gap weighted) n-gram collocations; i.e., their kernel counts the overlap of n-gram sequences surrounding the two target words.
bag-of-walks kernels compute multi-word co-occurrence in the syntactic/semantic structure present in parse graphs.