The data for the pre-training approach is generated using an oracle, an agent capable of finishing a game perfectly in the least number of steps possible.
the agent knows exactly what action to take given the state observation in order to advance the game in the most optimal manner possible.