Sign in to follow this  
Adam_a

NVIDIA Announces Scalable GPU-Accelerated Supercomputer in the Microsoft Azure Cloud

Recommended Posts

To build this new scalable GPU-accelerated supercomputer, Microsoft and NVIDIA engineers used 64 NDv2 instances on a pre-release version of the cluster to train BERT in approximately three hours. This was possible due to the multi-GPU optimizations provided by NCCL, an NVIDIA CUDA X library, and high-speed Mellanox interconnects.

 

 

NVIDIA Announces Scalable GPU-Accelerated Supercomputer in the Microsoft Azure Cloud

 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this