We can see that even without feature engineering or unsupervised pretraining, our C2W model (row "C2W") is on par with the current state-of-the-art system (row "structReg").
if we add hand-crafted features, we can obtain further improvements on this dataset (row "C2W + features").