The belief state is the posterior probability distribution over the underlying state u t of the system.
s t deterministically keeps track of all possible states that the OOHMM might be in-just as the state of a determinized FSA keeps track of all possible states that the original nondeterministic FSA might be in.