Given a training example set S = {t i = (o i , X 1 i , X 2 i )}, the average reconstruction error on the source side on the training set is defined as  (S; θ), can be computed in a similar way.
the reconstruction error is defined as E rec (S; θ) = E rec,s (S; θ) + E rec,t (S; θ).