Auto-Filling SEO Website as a Gift

Launch Your AI-Powered Business and get clients!

No advertising investment needed—just results. AI finds, negotiates, and closes deals automatically

Sept. 24, 2024, 10:30 a.m.
241

Intel Launches Gaudi 3 AI Accelerator: Competitive Pricing and Enhanced Features

Intel has officially launched its Gaudi 3 accelerator targeted at AI workloads today. While the new processors are slower than Nvidia's widely used H100 and H200 GPUs for AI and HPC applications, Intel is focusing on Gaudi 3's competitive pricing and lower total cost of ownership (TCO) to drive its success. The Gaudi 3 processor features two chiplets, which house 64 tensor processor cores (TPCs—utilizing a 256x256 MAC structure with FP32 accumulators), eight matrix multiplication engines (MMEs—256-bit wide vector processors), and a 96MB on-die SRAM cache with an impressive 19. 2 TB/s bandwidth. Additionally, Gaudi 3 comes equipped with 24 200 GbE networking interfaces and 14 media engines capable of processing H. 265, H. 264, JPEG, and VP9, thus supporting vision-related tasks. The unit is paired with 128GB of HBM2E memory across eight memory stacks, delivering a substantial bandwidth of 3. 67 TB/s. Compared to its predecessor, Gaudi 2, which includes 24 TPCs, two MMEs, and 96GB of HBM2E memory, the Gaudi 3 signifies a notable upgrade. However, it appears that Intel has simplified the architecture, as the Gaudi 3 processor now only supports FP8 matrix operations and BFloat16 matrix and vector operations, eliminating support for FP32, TF32, and FP16. In terms of performance, Intel claims the Gaudi 3 can achieve up to 1856 BF16/FP8 matrix TFLOPS and 28. 7 BF16 vector TFLOPS, all while operating at around 600W TDP. On paper, when compared to Nvidia's H100, Gaudi 3 shows slightly lower BF16 matrix performance (1, 856 vs. 1, 979 TFLOPS), half the FP8 matrix performance (1, 856 vs.

3, 958 TFLOPS), and significantly reduced BF16 vector performance (28. 7 vs. 1, 979 TFLOPS). However, beyond the technical specifications, the actual real-world performance of Gaudi 3 will be crucial. It must contend with AMD's Instinct MI300 series and Nvidia's H100 and B100/B200 processors. This competition rests heavily on software performance and other variables, which are yet to be fully assessed. Currently, Intel has shared slides suggesting that Gaudi 3 may provide a substantial price-to-performance advantage compared to Nvidia's H100. Earlier this year, Intel announced that a complete accelerator kit featuring eight Gaudi 3 processors on a single baseboard would be priced at $125, 000, making the cost per processor approximately $15, 625. In comparison, an Nvidia H100 card is being sold for around $30, 678, illustrating Intel's plan for a significant pricing edge over its competitor. Nevertheless, with Nvidia's Blackwell-based B100/B200 GPUs potentially offering considerable performance benefits, it remains uncertain whether Intel can sustain its competitive advantage.



Brief news summary

Intel has introduced the Gaudi 3 accelerator, designed for cost-effective AI applications. Although it falls short of matching the Nvidia H100 and H200 GPUs in performance, it boasts two chiplets featuring 64 tensor processor cores (TPCs) and an advanced 256x256 MAC architecture. The design includes eight matrix multiplication engines (MMEs) and a 96MB SRAM cache, offering an impressive bandwidth of 19.2 TB/s. Key features comprise 24 200 GbE interfaces, 14 media engines for vision processing, and 128GB of HBM2E memory, with a throughput of 3.67 TB/s. In comparison to its predecessor, Gaudi 2, which had 24 TPCs and 96GB of memory, the Gaudi 3 exhibits significant enhancements. However, it restricts matrix operations to FP8 and BFloat16, lacking FP32 support. The accelerator achieves notable performance metrics, recording 1856 BF16/FP8 matrix TFLOPS and 28.7 BF16 vector TFLOPS at approximately 600W TDP, yet it still trails behind Nvidia’s offerings. Priced at $125,000 for an eight-unit bundle, Gaudi 3 is more affordable than Nvidia’s H100 at $30,678. However, Intel must overcome considerable challenges in competing with Nvidia's market dominance and ensuring robust software support for its users.
Business on autopilot

AI-powered Lead Generation in Social Media
and Search Engines

Let AI take control and automatically generate leads for you!

I'm your Content Manager, ready to handle your first test assignment

Language

Learn how AI can help your business.
Let’s talk!

Hot news

July 7, 2025, 2:18 p.m.

Kinexys Launches Carbon Market Blockchain Tokeniz…

Kinexys by J.P. Morgan, the firm’s leading blockchain business unit, is developing an innovative blockchain application on Kinexys Digital Assets, its multi-asset tokenization platform, aimed at tokenizing global carbon credits at the registry level.

July 7, 2025, 2:15 p.m.

Ford CEO Jim Farley warns AI will wipe out half o…

Ford CEO Jim Farley recently emphasized the critical role of the “essential economy” and blue-collar skilled trades while forecasting that artificial intelligence will halve the number of white-collar jobs in the U.S. He has become the latest executive to raise concerns over AI’s impact on workers, joining voices like Amazon’s CEO, who last month announced that the company’s corporate workforce will shrink because of AI.

July 7, 2025, 10:27 a.m.

Cryptocurrency Theft Losses Reach Record High in …

In the first quarter of 2025, the cryptocurrency industry saw a dramatic surge in theft losses, totaling an unprecedented $1.63 billion.

July 7, 2025, 10:15 a.m.

AI in Education: Personalized Learning Experiences

In recent years, the education sector has experienced a notable shift toward integrating artificial intelligence (AI) to enhance learning experiences.

July 7, 2025, 6:46 a.m.

New Push for National AI Rules Likely After State…

A recent effort to impose a decade-long moratorium on state-level artificial intelligence (AI) regulations through the Republican budget bill, led by Senator Ted Cruz and supported by industry groups, has faced significant setbacks, revealing the growing complexities of AI governance in the U.S. The proposal aimed to prevent states from enacting individual AI policies to avoid a fragmented regulatory landscape that could hinder innovation and burden multi-state companies.

July 7, 2025, 6:27 a.m.

Investors Pile into Tokenised Treasury Funds

Crypto companies and investors are increasingly channeling funds into tokenised versions of money market and Treasury bond mutual funds as alternatives to stablecoins for parking excess cash while earning yield.

July 6, 2025, 2:15 p.m.

What is Blockchain? Demystifying the ledger that …

Best known as the technology powering Bitcoin, blockchain is emerging as a trustless, tamper-proof system with the capacity to revolutionize sectors from finance to healthcare.

All news