To address this difficulty through EP (section 4), we will need the ability to approximate any probability distribution p that is given by a WFSA, by choosing a "simple" distribution from a family Q.
that bookkeeping can be handled with an expectation semiring (Eisner, 2002), or simply with backpointers.