The search can be formulated as a Markov Decision Process (MDP) (Sutton and Barto, 1998): starting from e s , the agent sequentially selects an outgoing edge l and traverses to a new entity until it arrives at a target.
the MDP consists of the following components (Das et al., 2018).