DELL Poweredge XE9680L Server Overview

DELL Poweredge XE9680L Server Overview

OLEKSANDR SYZOV

DELL Poweredge XE9680L Server Overview

The Dell PowerEdge XE9680L is a high-performance, direct liquid-cooled rack server designed for the most demanding AI and High-Performance Computing (HPC) workloads. It's a powerhouse optimized for intensive computational tasks, particularly those involving large language models (LLMs) and large-scale AI inferencing.

DELL Poweredge XE9680L Server Overview

Here's a breakdown of its technical specifications and intended tasks:

Technical Specifications:

  • Processors: Two 5th Generation Intel Xeon Scalable processors, with up to 64 cores per processor. These offer enhanced memory performance and more, faster I/O with PCIe Gen 5.
  • Accelerators (GPUs):
    • Supports 8 NVIDIA HGX H200 141GB 700W SXM5 GPUs, fully interconnected with NVIDIA NVLink technology.
    • Can also support 8 NVIDIA HGX B200 180GB 1000W SXM6 GPUs with NVLink technology.
    • Other options include 8 AMD Instinct MI300X 192GB 750W OAM accelerators with AMD Infinity Fabric connectivity or 8 Intel Gaudi3 128GB 900W OAM accelerators with embedded RoCE ports.
    • The "L" in XE9680L signifies a focus on higher GPU density in a 4U form factor, offering 33% more GPU density per node compared to the XE9680.
  • Cooling: Features advanced Direct Liquid Cooling (DLC) for both CPUs and GPUs, improving overall efficiency and thermal management for high-wattage components.
  • Memory:
    • 32 DDR5 DIMM slots.
    • Supports RDIMM (Registered DIMM) with a maximum of 4 TB RAM.
    • DIMM speeds up to 5600 MT/s with 5th Generation Intel Xeon Scalable processors at 1 DPC (DIMM per channel) or 4400 MT/s at 2 DPC.
  • Storage:
    • Front Bays: Up to 8 x 2.5-inch NVMe/SAS/SATA SSD drives (max 122.88 TB) or up to 16 x E3.S NVMe direct drives (max 122.88 TB).
    • Internal Boot: Boot Optimized Storage Subsystem (NVMe BOSS-N1) with HWRAID for 2 x M.2 SSDs.
  • Power Supplies:
    • 2800W Titanium 200-240 VAC or 240 VDC, hot-swap redundant.
    • For NVIDIA B200 GPUs, it may use 6 x 3000W AC Titanium PSUs with support for 3+3 FTR and 5+1 redundancy policies.
  • Fans: Multiple high-performance (HPR) gold-grade fans for additional cooling, especially in the mid and rear sections.
  • Ports:
    • Network Options: 1 x OCP 3.0 (x8 PCIe lanes), optional 2 x 1GbE LOM.
    • Front Ports: 1 x iDRAC Direct (Micro-AB USB), 1 x USB 2.0, 1 x VGA.
    • Rear Ports: 1 x USB 2.0, 1 x USB 3.0, 1 x VGA, 1 x RJ45 iDRAC9 ethernet port.
  • PCIe Expansion: 12 x PCIe 5.0 full-height, half-length slots, providing significant expansion capability for network I/O and other peripherals.
  • Dimensions (approximate):
    • Height: 174.3 mm (6.86")
    • Width: Upper 2U: 447 mm (17.59"), Lower 2U: 434 mm (17.08")
    • Depth: 1037.57 mm (40.82") with bezel, 1025.62 mm (40.37") without bezel
  • Weight: Up to 91.63 kg (202.00 pounds)

Intended Tasks and Use Cases:

The Dell PowerEdge XE9680L is purpose-built for the most demanding and computationally intensive workloads, specifically in the realm of AI and HPC:

  • AI/Machine Learning (ML) Training: Its primary focus is on training large and complex AI models, including:
    • Large Language Models (LLMs): Ideal for the development and training of foundational LLMs, requiring immense GPU power and high-speed interconnects.
    • Deep Learning Models: Accelerates the training of various deep learning architectures for tasks like image classification, object detection, medical image segmentation, speech-to-text, and natural language processing.
  • AI Inferencing: Capable of performing large-scale AI inferencing, where trained models are used to make predictions or decisions on new data.
  • High-Performance Computing (HPC): Suitable for HPC applications that require massive parallel processing capabilities, such as scientific simulations, data analytics, and computational fluid dynamics.
  • Generative AI: Its powerful GPU and interconnect capabilities make it an excellent choice for developing and deploying generative AI solutions.
  • Dense GPU-Accelerated Deployments: Designed for environments where maximizing GPU density per rack is crucial, offering industry-leading density for NVIDIA GPUs in an x86 rack.
  • Data-Intensive Tasks: Its combination of powerful CPUs, ample memory, fast storage, and high-bandwidth interconnects allows it to handle data-intensive tasks efficiently.

In essence, the PowerEdge XE9680L is Dell's answer to the escalating computational demands of modern AI and HPC, providing a highly dense, liquid-cooled platform that can accelerate innovation and deliver optimal performance for cutting-edge research and enterprise applications.

 

Найкращі ціни на офіційні сервери DELL PowerEdge R760 в Україні. 

Безкоштовна консультація по телефону +38 (067) 819 38 38

Доступні моделі серверів зі складу у Києві:

Сервер Dell PowerEdge R760 - Intel Xeon Silver 4510 2.4-4.1Ghz 12 Cores 

Сервер Dell PowerEdge R760 - Intel Xeon Silver 4514Y 2.0-3.4Ghz 16 Cores 

Сервер Dell PowerEdge R760 - Intel Xeon Gold 6526Y 2.8-3.9Ghz 16 Cores

Сервер Dell PowerEdge R760 - Intel Xeon Gold 5420+ 2.0-4.1Ghz 28 Cores

Back to blog