Specifically, We propose to employ a knowledgeable AT demonstrator to supervise every decoding state of NAT across different time steps and lay-ers.
imitate-NAT leads to remarkable improvements and largely closes the performance gap between NAT and AT on several benchmark datasets.