This leads to redundancy in these overparametrized tensors which explains their low rank (Figure 1).
the presence of noise or incomplete values breaks these natural correlations and leads to higher rank tensor representations.