RL Swarm is an open source system for peer-to-peer gossip-based reinforcement learning over the internet.