Expert algorithms for combining prediction systems have been well studied.
experiments with the popular weighted majority algorithm (Littlestone and Warmuth, 1989) yielded poor performance since it attempts to learn the optimal balance between systems while our setting has rapidly shifting quality between few experts with little data for learning.