Well-known theoretical work shows that networks with as few as one hidden layer are able to approximate any function (Hornik et al., 1989).
this result does not reveal much neither about test performance nor about the semantic structure of the mapped vectors.