The method proposed in this article for learning a policy from a pre-existing corpus of dialogues can be used to find such an initial policy.
this "pure RL" policy simply selects the action a with the highest Q data (s, a) given the state s. As demonstrated by the evaluation in Section 3, this policy performs very badly.