It can be seen as the intrinsic dimensionality of a latent embedding of the elementary feature vectors.
a standard approach to control the capacity of a linear classifier is to use 1 or 2 regularization on the parameter vector.