The recently introduced online confidence-weighted (CW) learning algorithm for binary classification performs well on many binary NLP tasks.
for multi-class problems CW learning updates and inference cannot be computed analytically or solved as convex optimization problems as they are in the binary case.