NVIDIA launches DGX™ A100, the Universal System for Every AI Workload

NVIDIA DGX A100 is the universal system for all AI workloads, offering unprecedented compute density, performance and flexibility in the world’s first 5 petaFLOPS AI system. Download the NVIDIA DGX A100 data sheet.

NVIDIA has just announced the introduction of the NVIDIA DGX™ A100, the world’s first 5 petaFLOPS AI system. The new system offers unprecedented compute density, performance, and flexibility with the NVIDIA A100 Tensor Core GPU.

Integrating eight A100 GPUs, the system provides unprecedented acceleration and is fully optimized for NVIDIA CUDA-X™ software and the end-to-end NVIDIA data center solution stack.

The A100 sets a new bar for compute density, packing 5 petaFLOPS of AI performance into a 6U form factor, replacing legacy infrastructure silos with one platform for every AI workload.

NVIDIA DGX A100 features Mellanox ConnectX-6 VPI HDR InfiniBand/Ethernet network adapters with 450 gigabytes per second (GB/s) of peak bi-directional bandwidth. This is one of the many features that make DGX A100 the foundational building block for large AI clusters such as NVIDIA DGX SuperPOD™, the enterprise blueprint for scalable AI infrastructure.

NVIDIA DGX A100 features eight NVIDIA A100 Tensor Core GPUs1 providing unmatched acceleration at every scale and is fully optimized for NVIDIA CUDA-X software and the end-to-end NVIDIA data center solution stack. Download the NVIDIA DGX A100 data sheet.

The Universal System for Every AI Workload
With the fastest I/O architecture of any DGX system, NVIDIA DGX A100 is the universal system for all AI infrastructure, from analytics to training to inference. It sets a new bar for compute density, packing 5 petaFLOPS of AI performance into a 6U form factor and replaces legacy compute infrastructure with a single, unified system that can do it all. Its 8 NVIDIA A100 Tensor Core GPUs can be used together to run the largest jobs, or divided into as many as 56 separate and fully isolated instances with dedicated high bandwidth memory, cache, and compute cores. The combination of dense compute power and complete workload flexibility makes DGX A100 ideal for both single node deployments and large scale clusters.

Integrated Access to Unmatched AI Expertise
NVIDIA DGX A100 is more than a server, it is a complete hardware and software platform backed by thousands of AI experts at NVIDIA, and is built upon the knowledge gained from the world’s largest DGX proving ground, NVIDIA DGX SATURNV. Owning a DGX A100 system gives you direct access to a global team of AI-fluent practitioners that offer prescriptive guidance and design expertise to help fastrack AI transformation with know-how and experience from NVIDIA’s decade plus of AI leadership. This ensures mission-critical applications get up and running quickly and stay running smoothly, dramatically improving time to insights.

Fastest Time To Solution
NVIDIA DGX A100 features eight NVIDIA A100 Tensor Core GPUs1 providing unmatched acceleration at every scale and is fully optimized for NVIDIA CUDA-X software and the end-to-end NVIDIA data center solution stack. The unprecedented compute performance of DGX A100 delivers the fastest time-to-solution allowing users to iterate faster on the world’s most complex AI solutions.

Unmatched Data Center Scalability
NVIDIA DGX A100 is the foundational building block for large AI clusters such as NVIDIA DGX SuperPOD. DGX A100 debuts next generation NVLink and NVSwitch that are 2X faster than the previous generation and Mellanox ConnectX-6 VPI HDR InfiniBand/Ethernet network adapters with 450 gigabytes per second (GB/s) of peak bi-directional bandwidth. The combination of massive GPU-accelerated compute with state-of-the-art networking and GPU-accelerated software means DGX A100 can scale to hundreds or thousands of nodes to meet the biggest challenges such as conversational AI and large scale image classification.

The World’s Most Secure AI System For Enterprise
NVIDIA DGX A100 delivers the most robust security posture for your AI enterprise, with a multi-layered approach that secures all major hardware and software components. Stretching across the baseboard management controller (BMC), CPU board, GPU board, self-encrypted drives, and secure boot, DGX A100 has security built-in, allowing users to focus on results rather than threat assessment and mitigation.