2 There are not major differences between goal oriented and fidelity oriented agents, highlighting the problematic nature of R2R paths with respect to instruction following: essentially, rewards that only take into account the goal implicitly signals path conformity-by the construction of the dataset itself.
an agent optimized to reach the 2 Our goal oriented results match the RCM benchmark on validation unseen but are lower on validation seen.