The features used in their model are very simple.
they use use word lengths and frequencies, like us, as well as distances between tokens (important in a transitionbased model), and, finally, the history of previous decisions.