In the GRU equation, for the first target hidden layer, x i represents the previously generated word, and h i−1 encodes the hypothesis up to two words before the current word.
if two partial hypotheses in the beam only differ by the last emitted word, their h i−1 vectors will be identical.