https://openreview.net/forum?id=S1dIzvclg&noteId= H1LYxY84l The author propose to use a off-policy actor-critic algorithm in a batch-setting to improve chatbots.The approach is well motivated and the paper is well written, except for some intuitions for why the batch version outperforms the on-line version (see comments on "clarification regarding batch vs. online setting").The artificial experiments are instructive, and the real-world experiments were performed very thoroughly although the results show only modest improvement.
the major hurdle lies in to decide the acceptance and rejection of the manuscripts based on the reviews received from the reviewers.