This is based on the observation that token based transduction grammars suffer from a lack of fluency; a consequence of the degree of expressivity they permit.
as a principal part of our investigation we compare the quality of responses generated using a combination of token based rule induction and top-down rule segmenting transduction grammars to those generated by pure token based transduction grammars.