Dell PowerEdge R760xa Server Review with Dual NVIDIA H100 NVL 94GB.
Dell PowerEdge announcements at NVIDIA GTC include new eight-core GPUs, artificial intelligence Ethernet technologies, and Dell's first ARM processor.
The Dell PowerEdge XE9680 is our flagship server with eight-processor acceleration for generative AI training, model tuning, and large-scale AI inference. The Dell PowerEdge XE product family gives you the freedom to choose from air-cooled or ultra-dense liquid-cooled configurations. PowerEdge XE servers offer even more accelerated computing capabilities, such as the powerful eight-core NVIDIA Tensor Core H100 processor in the PowerEdge XE9680 or the quad-core NVIDIA H100 HGX processor in the PowerEdge XE9640 and PowerEdge XE8640. PowerEdge XE servers are NVIDIA certified systems and include advanced NVIDIA Quantum-2 InfiniBand and Spectrum-X Ethernet networking solutions, as well as NVIDIA AI Enterprise software.
The highly flexible PowerEdge XE9680 celebrates three generations of NVIDIA GPUs. At launch, the XE9680 supported NVIDIA A100 Tensor Core GPUs based on the NVIDIA Ampere architecture and NVIDIA H100 Tensor Core GPUs based on the NVIDIA Hopper architecture. Today, Dell is announcing support for NVIDIA’s new Blackwell architecture GPUs for AI acceleration and future updates.
Dell PowerEdge XE9680 supports NVIDIA HGX H200
The PowerEdge XE9680 adds support for NVIDIA H200 Tensor Core GPUs and BlueField-3 super NICs. The NVIDIA HGX H200 upgrade is based on the same eight-processor NVIDIA Hopper architecture as the PowerEdge XE9680 with NVIDIA HGX H100 with improved HBM3e memory. With an increased memory capacity of 141 GB per GPU, the PowerEdge XE 9680 is expected to be able to accommodate more AI model parameters for training and inference in the same 6RU air-cooled profile to lower the total cost of ownership (TCO). The NVIDIA BlueField-3 SuperNIC accelerates and offloads the clustered network traffic typical of large AI models by providing direct communication between GPUs and accelerating decision times.
Dell PowerEdge XE9680 air-cooled with NVIDIA HGX B100
The PowerEdge XE9680 with NVIDIA Blackwell HGX B100 GPU family will offer enterprises a next-generation eight-thread GPU for generative AI with more compute power at the same 700W power consumption as the NVIDIA HGX H100. The air-cooled PowerEdge XE9680 with NVIDIA HGX B100 GPUs will feature a whopping 1.54TB of total HBM3e memory with NVIDIA NVLink, enabling your business to capture accurate GenAI data with models containing trillions of parameters.
Dell's NVIDIA GB200 NVL72 Multi-Node Scalable Server Architecture Will Outperform Eight GPU Servers for Large AI Models by Using Up to 72 GPUs Interconnected via NVLink Technology
Dell is also announcing its first ARM processor with the NVIDIA GB200 superchip for the first time. Dell will partner with NVIDIA to offer a next-generation computing platform based on NVIDIA’s Grace hybrid ARM CPU with integrated B200 GPUs based on the Blackwell microarchitecture.
This new architecture will be the new king of the hill for inferencing and training the largest AI models with many trillions of parameters. The GB200 NVL72 multi-node scalable server architecture will offer an ultra-dense system of 72 NVIDIA NVLink GPUs interconnected in a single rack.
Dell PowerEdge support for NVIDIA BlueField-3 Ethernet adapters
Dell PowerEdge offers users even more choice with support for NVIDIA BlueField-3 super cards for NVIDIA Spectrum-X high-performance Ethernet for AI. This high-performance fabric combines the NVIDIA Spectrum-4 switch and BlueField-3 super cards within the NVIDIA OVX and NVIDIA HGX reference architectures to power NVIDIA Omniverse and NVIDIA AI Enterprise workloads.
How can we help?
For more detailed information about the DELL PowerEdge R760 server with DDR5 4800 or the DELL PowerEdge R750 server with DDR4 3200, you can visit our SERVER SOLUTIONS website . To find out the cost of the server, click on the DELL Server Configurator link .