The word drop probability is normally set to 0.25, since using a higher probability may degrade the model performance (Bowman et al., 2016).
the VHRED is trained to predict a next target utterance x t conditioned on the context h cxt t which encodes information about previous utterances {x 1 , .