This was mainly because the phoneme-length context model accelerated the segmentation in the early epochs, and the small number of observations and un-supervised condition caused over-fitting.
the performance of the NPYLM-D is expected to be improved by using a larger corpus or by optimizing hyper parameters to match the actual prior probability of phoneme length.