For large-scale data sets, on-line training methods can be much faster than batch training methods.
we find that the existing on-line training methods are still not good enough for training large-scale NLP systems-probably because those methods are not well-tailored for NLP systems that have massive features.