We can see that both models performs poorly, achieving the accuracy of only 68.6% for the knowledge component, similar to the accuracy achieved by the "opt-joint" method.
our mutual distillation framework offers the best performance.