To make P (Y 1 |X 1 ) and P (Y 2 |X 2 ) generalize well at test time, we hope to remove unnecessary information from X 1 and X 2 .
we want X 1 (X 2 ) to be a minimal sufficient statistic for Y 1 (Y 2 ).