This might be the result of the tuning process of the sparse rational structure simply learning a collection of words, rather than coherant phrases.
this WFSA is treated as a unigram pattern rather than a trigram.