d (k+1) is the representation of document s (k+1) using Self-Attentive Encoder,û is the output words after the second-pass decoder.
to the original Deliberation Network (Xia et al., 2017), where they propose a complex joint learning framework using Monte Carlo Method, we minimize the following loss as Xiong et al.