Also, deep networks are highly non-linear models, and the parameter dimensions have complex interactions, making the Euclidean space of parameters not a proper delegate of model behavior (French, 1999).
a slight change in parameter space could affect the model prediction unexpectedly.