The framework consists of three modules: a multi-domain Dialog State Tracker (DST) at the dialog act level, a dialog policy module for deciding the next dialog act, and a reward estimator for policy evaluation.
given a set of collected human dialog sessions D = {τ 1 , τ 2 , .