In fact, unlike chat-bots and open domain dialogs where BLEU score does not correlate with human evaluation , in task-oriented dialogs the answers are constrained to particular entities and recurrent patterns.
we believe BLEU score still can be considered as a relevant measure.