Facebook published a paper today detailing how they are able to train nearly 1.3 million images in under an hour using 256 Tesla P100 GPUs that previously took days on a single system. The team reduced the training time of a ResNet-50 deep learning model on ImageNet from 29 hours to one �C which they did so by distributing training in larger minibatches across more GPUs. Previously��
]]>