We solve the second problem in a Bayesian probabilistic framework.
we test each classifier on a test corpus of 5000 examples labeled with and 5000 examples labeled with , which ensures that the baseline is the same for all combinations and , namely 50%.