6 This model can be used for generation: sampling from the model yields words or phrases that match the frequency statistics of the corpus.
rather than offering representative samples from h 0 , most deployed systems instead sample from p(w i ) / h 0 (w i ) 1/⌧ , where ⌧ is a "temperature" parameter; ⌧ = 1 corresponds to sampling based on p 0 (soft-max), while ⌧ !