The second intuition of the criterion used by Srinivas and Babu (2015) is that neurons with small outgoing weights contribute very little overall.
they search for a pair of neurons i, j ∈ [1, m] according the following term and remove the j-th neuron.