Figure 3 shows that for a given window, the re-embedding performs better when the dimensionality of the learned manifold is chosen to be closer to the original space dimensionality.
dimensional reduction on the original space will bare a cost in performance.