We observe that due to weak signal strength and enlarged search space from multiple domains, WEAK-COMBINED model performs poorly across domains.
each expert e k provides a transformed training dataset to the student , where (p k θ ) i is the expert's probability distribution on the entire program space w.r.t input utterance x i .