ASUS ESC A8A-E12U Best high-density server for AI Inference
AMD Instinct MI325X and MI350 series with EPYC 9005 processors
ASUS ESC A8A-E12U is a 7U dual-socket GPU server powered by the latest AMD EPYC™ 9005 processors and AMD Instinct™ MI325X or MI350 series accelerators. Featuring high memory bandwidth and optimized power efficiency, ESC A8A-E12U is the ideal solution for high-end AI training and large-scale model inference. Featuring a boosted frequency of up to 5GHz, the 64-core AMD EPYC 9575F processor ensures GPUs meet the stringent data requirements of intensive AI workloads, delivering unparalleled speed and efficiency for cutting-edge applications.
Key Platform Highlights
- Fueled by dual AMD EPYC™ 9005 processors, featuring the 9575F CPU with high-frequency optimization tailored for AI workload and 400W TDP support. Its high vCPU density and x86 architecture ensure seamless integration with existing infrastructure.
- Improved performance with the AMD Instinct MI325X and MI350 series eight-GPU platform, featuring GPU Direct Storage to significantly reduce read and write latency.
- A dedicated one-GPU-to-one-NIC topology that supports up to eight NICs for the highest throughput, delivering 896GB/s bandwidth during compute-intensive workloads.
- Increased HBM3E memory capacity of up to 288GB HBM and 8 TB/s bandwidth on MI350 series, and 256GB HBM and 6 TB/s on MI325X per GPU, optimize performance for large AI models and HPC workloads.
- Modular design with reduced cable usage to shorten assembly time and improve thermal optimization.
One-GPU-to-one-NIC topology
Seamless connection across eight GPUs
AMD Instinct MI325X/MI350 series, with Infinity Fabric™ mesh topology and PCIe 5.0 connectivity, enables direct GPU-to-NIC connections, ensuring high bandwidth, low latency and optimized performance for distributed advance AI training.
AMD ROCm open software platform
Optimized for seamless AI development and deployment
ESC A8A-E12U leverages the AMD ROCm™ open software platform to enable seamless deployment of AI workloads. It supports frameworks such as TensorFlow, PyTorch and JAX, ensuring high parallel computing efficiency, improved software compatibility, and exceptional scalability for a wide range of AI and HPC applications and frameworks.
Eight AMD Instinct MI350 series or MI325X GPUs
Designed to accelerate AI inference and training
ESC A8A-E12U with AMD Instinct MI350 series or MI325X accelerators delivers superior performance, enabling processing of trillion-parameter models with HBM3E memory capacity of up to 288GB per OCP Accelerator Module, and reduced total cost of ownership.
Sustainability
Keep your data center green
Data centers can consume huge amounts of electricity, raising environmental concerns. ASUS servers are designed to optimize both total cost of ownership (TCO) and total cost to the environment (TCE), including thermal design, power efficiency and advanced cooling solutions — reducing the impact of our products on the planet.
Air Cooling Solution
Compact 7U form factor for maximum efficiency
ESC A8A-E12U delivers high-end GPU performance in the most compact 7U air-cooled form factor. It combines optimized thermal design with independent CPUand GPU airflow tunnels to ensure superior heat dissipation, and enhance energy efficiency and power savings.
5+1 power supplies
High level of power efficiency
To reduce operating costs, ESC A8A-E12U provides effective cooling and innovative components. The 80 PLUS® Titanium power supplies come in a redundant 5+1 arrangement to efficiently deliver an abundance of power.
Management
Comprehensive IT infrastructure solutions
- Advanced ASUS management tools comprise IT assets management, security and reliability to improve the performance, up-time and real-time monitoring of the servers remotely — highly increasing the efficiency of IT infrastructure.
BMC
Remote server management
- ASUS ASMB11-iKVM is the latest server-management solution from ASUS, built upon the ASPEED 2600 chipset running on the latest AMI MegaRAC SP-X. The module provides various interfaces to enable out-of-band server management through WebGUI, Intelligent Platform Management Interface (IPMI) and Redfish® API.
IT infrastructure-management software
- Streamline IT operations via a single dashboard
ASUS Control Center (ACC) is remote IT-management software application designed for monitoring hardware and software IT assets and inventory status, and enabling seamless remote BIOS configurations and updates, efficient IT diagnostics and troubleshooting and enhanced security with hotfix updates — allowing easier server management for any IT infrastructure.
Hardware Root-of-Trust Solution
- Detect, recover, boot and protect
ASUS servers integrate PFR FPGA as the platform Root-of-Trust solution for firmware resiliency to prevent from hackers from gaining access to infrastructure. ASUS security solutions are fully compliant with the 2018 National Institute of Standards and Technology (NIST) SP 800 193 specification.
* Platform Firmware Resilience (PFR) module must be specified at time of purchase and is factory-fitted. It is not for sale separately.
Trusted Platform Module 2.0
- Detect, recover, boot and protect
ASUS servers integrate PFR FPGA as the platform Root-of-Trust solution for firmware resiliency to prevent from hackers from gaining access to infrastructure. ASUS security solutions are fully compliant with the 2018 National Institute of Standards and Technology (NIST) SP 800 193 specification.
* Platform Firmware Resilience (PFR) module must be specified at time of purchase and is factory-fitted. It is not for sale separately.
