We finally perform human evaluation for a more thorough system comparison in terms of different aspects.
we use the DialCrowd toolkit (Lee et al., 2018) to setup human evaluation interfaces, and undertook two types of human studies as below.