In the standard beam search, the top k words of highest probability are selected deterministically based on the softmax output to expand each hypothesis.
this may lead to suboptimal output for text generation (Wiseman and Rush, 2016), e.g., one beam often dominates and thus inhibits hypothesis diversity.