Online algorithms have the potential to speed up learning by making updates more frequently.
these updates can be seen as noisy approximations to the full batch update, and this noise can in fact impede learning.