Extending the study to the multi-agent scenario is feasible and desirable, as multiple agents might supply more reliable and diverse advantages compared to the two-agents scenario.
the agent is expected to learn advantages from each other in the multi-agent scenario, which results in a complex many-to-many learning problem( Figure  1.(b)).