Efficient communication and coordination for large-scale multi-agent systems