The constraint implies that the "best" action sequence should rank higher than any other sequence by a margin computed from rewards as R(h * ) − R(h).
the superior performance of MMRN-JOINT shows that the joint learning plays a crucial role in addition to the choices of architecture.