NVIDIA designed the H100 Tensor Core GPU for exactly these workloads, and it is quickly becoming one of the most popular accelerators for training large language models. This is for a good reason.

NVIDIA's new H200 Tensor Core GPU is a drop-in upgrade for an instant performance boost over H100, with 141GB of HBM3E (80GB HBM3 on H100) and up to 4.8TB/sec of memory bandwidth with H200 versus ...