Our main motivation for unfolding is to obtain a single network with ensemble level performance which can be shrunk with the techniques in Sec.
unfolding is an alternative to ensembling of multiple neural networks with the same topology.