We see that: 1) Although all methods lead to different degrees of improvement, our framework outperforms all other competitors with a large margin.
2) compared to the pipelined method in Row 6 which is in analogous to the structure compilation work (Liang et al., 2008), our iterative distillation (section 3.2) provides better performance.