(a) We observe significantly different levels of complexity dependent on the population ratio.
the cost function is then: whereV (h) refers to using the predicted value but not updating the value sub-network according to this loss function.