However, larger data sets come with increased demands on computational resources; moreover, they tend to include redundant information as their size increases.
the performance gain curves of large-scale systems with respect to the amount of training data often show "diminishing returns": new data is often less valuable (in terms of performance gain) when added to a larger pre-existing data set than when added to a smaller pre-existing set (e.g., (Moore, 2003)).