5 A comparison of available Vietnamese tokenization tools is reported in (Dinh et al., 2008).
the CRFbased tool of the group (Tu et al., 2006), the PVnSeg tool (unknown source) and the hybrid method of (Hong Phuong et al., 2008) are compared using a test corpus containing 1,264 articles from Politics-Society section of a Vietnamese online newspaper "Tuoi Tre", where words have been manually segmented by linguists.