Article
eCommerce & Retail Tech

Intel patent hints at a cheaper way to feed AI chips

by TechDefused Newsroom
The image showcases a close-up view of a computer motherboard prominently featuring an Intel Core Ultra processor. The vibrant blue circuitry is detailed with various electronic components and pathways that highlight modern technological design. — Credit: Photo by BoliviaInteligente on Unsplash c Photo by BoliviaInteligente on Unsplash

Intel has filed a patent describing a new way to build the memory that AI chips depend on, potentially removing one of its most expensive components.

To understand why that matters, start with the bottleneck.

Modern AI chips can perform calculations far faster than memory can supply them with data, so performance often depends less on the processor than on how quickly information reaches it.

The industry's current answer is high bandwidth memory, or HBM, which stacks memory chips vertically right next to the processor so data has a shorter distance to travel.

HBM works, but it is costly, and one reason is a component called a silicon interposer.

This is essentially an intricate silicon bridge that sits beneath the chips and carries thousands of tiny wires between them, and it is difficult and expensive to manufacture.

Intel's patent, published on 2 July, describes an alternative it calls cross-batch memory, or XBM.

The design aims to occupy the same physical space as HBM4, the next generation of the current standard, while eliminating the interposer entirely.

Instead of thousands of parallel connections, it would use a smaller number of faster serial links based on UCIe, an industry standard for connecting chip components.

The memory itself would be built differently too, fabricated during the later manufacturing stages of a chip rather than made separately and stacked on top.

If it worked, the result would be memory that performs comparably to today's leading technology at lower cost.

That is a large "if".

The patent sets commercialisation only after 2030, and aligns the work with Intel's Z-Angle Memory project with SoftBank's SAIMEMORY venture.

History counsels caution here.

The record of proposed new memory technologies is littered with far more failures than successes, and most never reach production at all.

A patent application is a statement of intent rather than a product, and this one would need roughly a decade of development, manufacturing investment and industry adoption before it appeared in any data centre.

Intel's involvement nonetheless gives the effort more weight than a typical filing.

The company has a long history of creating industry standards that others adopt, and it retains influence across the server and networking hardware that data centres are built from.

Memory is also the point where the AI hardware market is most strained, with prices at record levels and supply short.

Any credible route to cheaper high-performance memory would attract attention across the industry.

For now, though, this is a design on paper.

The realistic takeaway is that Intel is thinking seriously about the memory bottleneck, not that it has solved it.

by TechDefused Newsroom