Multi-view learning on data where features can be separated into distinct subsets has been well studied (Xu et al., 2013).
relevant are co-training (Blum and Mitchell, 1998) and co-regularization (Sindhwani and Belkin, 2005), which trains two models with disjoint views of the input.