, (s m i , a m i ) for each instructionx i .
the agent context, the information available to the agent at step k, is the execution up until but not including step k. to the world state, the agent context also includes instructions and the execution so far.