The IEMOCAP database (Busso et al., 2008), to the best of our knowledge, is the only dataset that provides emotion labels for each utterance.
iEMOCAP was created by actors performing emotions, and hence carries the risk of overacting.