The frequency components with higher energy (peaks in spectrum) are more dominant than those with lower energy (troughs) in determining the nature of the signal.
it makes sense to only include the peak frequencies into the model, because they are more "representative" of the signal, and so the "noise" from the low energy frequencies are filtered out.