However, directly computing expected reward requires traversing all the possible anonymous utterancex, which is unrealistic.
we leverage Monte Carlo estimate as the approximation of the expected reward.