The reliability of a parameter is measured with regard to its contribution to the model's entropy (Foster 2000).
we discard the parameters that least affect the overall probability of the training set.