We estimate the average number of active paths per node pair as T Ne 2 .
the overall time for this method per training iteration is O 2d(η + 1)E kb T We should note that whether this method or the one of Guu et al.