Previous work-the generative models described in Collins (1996) and the earlier version of these models described in Collins (1997)-conditioned on punctuation as surface features of the string, treating it quite differently from lexical items.
the model in Collins (1997) failed to generate punctuation, a deficiency of the model.