A convolution operates a filter w ∈ R n×e to a window of n words x i,i+n with bias term b by a i = σ(w • x i,i+n + b ) with non-linear activation  W,b (•) Figure 4: Group Sparse CNN.
different ways of initializing the projection matrix in Eq.