An interesting range of update rules work in the sequential setting.
the YS algorithms resemble the "Yarowsky-Cautious" algorithm of Collins & Singer (1999), though they differ from that algorithm in that they update a single feature in each iteration, rather than a small set of features, as in Yarowsky-Cautious.