Our initial findings indicate that, as more data becomes available the bounds tighten for most parameters in the transition matrix.
for some of the parameters the bounds can remain wide, and that is enough to keep the confidence interval for the expected cumulative reward from converging.