The structure of the fertility model violates the Markov assumptions used in this dynamic programming method.
we may empirically estimate the posterior distribution using Markov chain Monte Carlo methods such as Gibbs sampling (Zhao and Gildea, 2010).