pytorch多GPU并行计算

mark

参考：

pytorch(分布式)数据并行个人实践总结——DataParallel/DistributedDataParallel

https://zhuanlan.zhihu.com/p/39752167

https://ptorch.com/docs/8/cuda

https://www.cnblogs.com/yh-blog/p/12877922.html

https://www.zhihu.com/question/67726969?sort=created

https://blog.csdn.net/u013398034/article/details/83989808