UHG
Search
Close this search box.

Intel Unveils Xeon 6 Processors

These processors are designed for running RAG, which aims to deliver business-specific results by leveraging proprietary data.

Share

Xeon 6

Illustration by Tom's Hardware

At the Intel Vision 2024, the company has introduced its latest innovation in the realm of data centre, cloud, and edge computing with the launch of the new Intel Xeon 6 processors. 

Designed to offer performance-efficient solutions for running AI applications such as RAG, these processors aim to deliver business-specific results by leveraging proprietary data. The new brand, Intel Xeon 6, heralds a significant leap in processing power and efficiency, catering to the evolving needs of modern computing landscapes.

The current ‘Emerald Rapids’ Fifth-Gen Xeon models from Intel will not undergo a rebranding, indicating that the new branding scheme will exclusively pertain to Xeon 6 and subsequent processor iterations.

Under the hood, the Intel Xeon 6 processors boast two distinct variants: those equipped with Efficient-cores (E-cores) and those featuring Performance-cores (P-cores). 

The E-core processors, codenamed Sierra Forest, promise a remarkable 2.4x improvement in performance per watt and a staggering 2.7x enhancement in rack density compared to their predecessors, the 2nd Gen Intel Xeon processors. This advancement not only amplifies computational capabilities but also enables customers to replace outdated systems at a ratio of nearly 3-to-1, thereby substantially reducing energy consumption and contributing to sustainability goals.

On the other hand, the P-core processors, codenamed Granite Rapids, introduce software support for the MXFP4 data format. This integration results in a notable reduction in next token latency by up to 6.5x compared to the 4th Gen Intel Xeon processors using FP16. Furthermore, with the ability to run 70 billion parameter Llama 2 models, these processors are poised to elevate AI performance to unprecedented heights.

At the Intel AI Everywhere event in December, Intel had revealed the forthcoming release of 5th Gen Xeon processors, featuring AI acceleration in every core and expected to hit the market in 2024. Unveiled by Intel CEO Pat Gelsinger, these processors, previously codenamed Emerald Rapids, mark a significant advancement in computing. 

In addition to advancements in processing power, Intel has also announced significant developments in client, edge, and connectivity solutions. The company’s Intel Core Ultra processors are driving new capabilities for productivity, security, and content creation, presenting an enticing proposition for businesses to refresh their PC fleets. 

Intel anticipates shipping 40 million AI PCs in 2024, featuring over 230 designs spanning from ultra-thin PCs to handheld gaming devices.

Looking ahead, Intel’s roadmap includes the launch of the next-generation Intel Core Ultra client processor family, codenamed Lunar Lake, in 2024. This lineup is projected to deliver more than 100 platform tera operations per second (TOPS) and over 45 neural processing unit (NPU) TOPS, ushering in a new era of AI-centric computing.

Furthermore, Intel has unveiled new edge silicon across its product families, targeting key markets such as retail, industrial manufacturing, and healthcare. These additions to Intel’s edge AI portfolio are slated for availability this quarter and will be supported by the Intel Tiber Edge Platform throughout the year.

In a bid to revolutionise Ethernet networking for AI fabrics, Intel is spearheading the Ultra Ethernet Consortium (UEC), introducing a range of AI-optimised Ethernet solutions. These innovations are designed to cater to the evolving needs of large-scale AI fabrics, enabling seamless training and inferencing for increasingly complex models.

📣 Want to advertise in AIM? Book here

Picture of Mohit Pandey

Mohit Pandey

Mohit dives deep into the AI world to bring out information in simple, explainable, and sometimes funny words.
Related Posts
19th - 23rd Aug 2024
Generative AI Crash Course for Non-Techies
Upcoming Large format Conference
Sep 25-27, 2024 | 📍 Bangalore, India
Download the easiest way to
stay informed

Subscribe to The Belamy: Our Weekly Newsletter

Biggest AI stories, delivered to your inbox every week.

Flagship Events

Rising 2024 | DE&I in Tech Summit
April 4 and 5, 2024 | 📍 Hilton Convention Center, Manyata Tech Park, Bangalore
Data Engineering Summit 2024
May 30 and 31, 2024 | 📍 Bangalore, India
MachineCon USA 2024
26 July 2024 | 583 Park Avenue, New York
MachineCon GCC Summit 2024
June 28 2024 | 📍Bangalore, India
Cypher USA 2024
Nov 21-22 2024 | 📍Santa Clara Convention Center, California, USA
Cypher India 2024
September 25-27, 2024 | 📍Bangalore, India
discord-icon
AI Forum for India
Our Discord Community for AI Ecosystem, In collaboration with NVIDIA.