Distributed Decentralized Training of Neural Networks: A Primer Data Parallelism, Butterfly All-Reduce, Gossiping and More… Continue reading on Towards Data Science » Click here to read the article
