We conduct experiments on both the Blogs10 and Blogs50 datasets with and without the position embedding.
by "without position", we mean that the element-wise multiplication with the p j is removed from equation (1) in Section 3.