This method allows the use of an external evaluation measure as reward (Paulus et al., 2017).
we want to maximize the expected Smatch reward, where p θ is the policy specified by the parser parameters θ and g s is a graph sampled from p θ .