Intel unveils new AI chip Gaudi 3 Q2 availability begins,Industry News

Intel unveils new AI chip Gaudi 3 Q2 availability begins

Views : 180
Author : Calycomponents
Update time : 2024-04-11 12:28:46
Intel re-launched the new brand of Intel Xeon 6 processors, introduced the Intel Gaudi 3 gas pedal to help enterprises advance generative AI innovation with high performance, openness and flexibility, and released a full-stack solution covering a new open, scalable system, next-generation products, and a series of strategic collaborations to accelerate generative AI to the ground.
Among them, the Intel Gaudi 3 gas pedal will be Intel's weapon against Nvidia. Intel CEO Kissinger also has high hopes. Enterprises want to expand generative AI from the experimental stage to the application stage. As a result, they need rapidly deployable solutions built on high-performance, cost-effective, energy-efficient processors like Intel's Gaudi 3 AI gas pedal. And, Gaudi 3 also meets the needs of complexity, cost-effectiveness, fragmentation, data reliability, and compliance.
Intel Gaudi 3 AI gas pedals will power AI systems that can connect up to tens of thousands of gas pedals via the common standard of Ethernet, Intel said. Intel Gaudi 3 will deliver a 4x increase in BF16 AI compute power and a 1.5x increase in memory bandwidth compared to its predecessor. The gas pedal will bring a major leap forward in AI training and reasoning for organizations seeking to deploy generative AI at scale.
                                                                           
Intel Gaudi 3 is expected to dramatically reduce training time for 7 and 13 billion parameter Llama2 models, and 175 billion parameter GPT-3 models. It also demonstrates outstanding performance in terms of inference throughput and energy efficiency for the Llama 7B, 70B and Falcon 180B Large Language Models (LLMs). Intel Gaudi 3 gas pedals provide open, community-based software and industry-standard Ethernet networking, allowing organizations the flexibility to scale from a single node to clusters with thousands of nodes, superclusters and mega-clusters to support large-scale inference, fine-tuning and training.
For the Gaudi 3 chip, Intel said in a previous press briefing that the product is more than twice as energy efficient as NVIDIA's chips and runs AI models 1.5 times faster than NVIDIA's H100 GPU chip.
Intel Gaudi 3 will be available to OEMs starting in Q2 of this year, including Dell, Wisers, Lenovo, and US Supermicro.