AxoNN: An asynchronous, message-driven parallel framework for extreme-scale deep learning
Published in 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2022
Recommended citation: @INPROCEEDINGS{9820664, author={Singh, Siddharth and Bhatele, Abhinav}, booktitle={2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS)}, title={AxoNN: An asynchronous, message-driven parallel framework for extreme-scale deep learning}, year={2022}, volume={}, number={}, pages={606-616}, keywords={Training;Deep learning;Schedules;Neural networks;Memory management;Graphics processing units;Clustering algorithms;parallel deep learning;asynchrony;message driven scheduling;memory optimizations}, doi={10.1109/IPDPS53621.2022.00065}}
Download Paper