Side information is sometimes encoded as "virtual examples" like our contrast examples or pseudoexamples.
past work generates these by automatically transforming the training examples in ways that are expected to preserve or alter the classification (Abu-Mostafa, 1995).