These are learning experiments so we also use ten-fold cross validation in the same way as with CRF++.
we create a pattern file from 90% of the dataset using PATGEN, and then hyphenate the remaining 10% of the dataset using Liang's algorithm and the learned pattern file.