In our method, we use the state s t to keep track of the current confidence of target object represents the set of all the objects that can be chosen by the user.
the state s t is a probability distribution over all the objects and s t,i is the confidence that the object o i is the target object o tgt at time-step t. The initial state s 0 can either be a uniform distribution or initialized by the prior knowledge.