In most previous work the reward function is manually set, which makes it "the most hand-crafted aspect" of RL (Paek, 2006).
we learn the reward model from data, using a modified version of the PARADISE framework (Walker et al., 2000), following pioneering work by (Walker et al., 1998).