With this view in mind, we allow our instruction following agent to observe the environment and build a representation of it prior to seeing any linguistic instructions.
we adopt a semisupervised setup with two phases, as shown in Figure 2: an environment learning phase where the system sees samples of language-free state transitions from actions in the environment, and a language learning phase where instructions are given along with their corresponding effects on the en- vironment.