Intel®Gaudi® 2 AI accelerator
High Performance Acceleration for GenAI and LLMs
Our Intel® Gaudi® 2 AI accelerator is driving improved deep learning price-performance and operational efficiency for training and running state-of-the-art models, from the largest language and multi-modal models to more basic computer vision and NLP models. Designed for efficient scalability—whether in the cloud or in your data center, Intel Gaudi 2 accelerators bring the AI industry the choice it needs—now more than ever.
Intel Gaudi 2 AI architectural features:
built on the proven first-gen Intel Gaudi design foundation
- 7nm process technology
- Heterogeneous compute
- 24 Tensor Processor Cores
- Dual matrix multiplication engines
- 24 100 Gigabit Ethernet integrated on chip
- 96 GB HBM2E memory on board
- 48 MB SRAM
- Integrated Media Control
Intel Gaudi 2 Al accelerator in the Cloud
Discover the performance and ease of use Intel Gaudi 2 AI accelerator provides on the
Intel Developer Cloud.
And coming soon: Intel Gaudi 2 accelerators on the Stability.AI Cloud.
Intel Gaudi 2 Al accelerator in the Data Center
Bring the price-performance advantage into your infrastructure with solutions from Supermicro and IEI.
Intel Gaudi 2 AI accelerator
Training and Inference Performance delivers choice.
Based on MLPerf Training 3.0 Results published June 2023, Intel Gaudi 2 AI accelerator is the ONLY viable alternative to H100 for training
large language models like GPT-3.
Intel Gaudi 2 AI accelerator supports massive, flexible scale out.
With 24x 100 Gigabit Ethernet (RoCEv2) ports integrated onto every Intel Gaudi 2 AI accelerator, customers benefit from flexible and cost-efficient scalability that extends performance of the Intel Gaudi 2 AI accelerator from one to thousands of accelerators.
Figure1: Server reference design featuring 8x Intel Gaudi 2 accelerators
Planning for a new deployment for your workloads?
Your company can instantly access enterprise-grade infrastructure, including compute, storage, and networking, with LM Network’s Enterprise Bare Metal (EBM) service.
