This will look very similar to structured dropout: the matrix E[P] is identical, and E[Q] has off-diagonal elements which are scaled by (1 − p) 2 , which goes to zero as K is large.
by including these elements, standard dropout is considerably slower, as we show in our experiments.