News

[News] JEDEC Releases New HBM4 Spec as Memory Giants Gear up to Take the Lead


2024-07-15 Semiconductors editor

As top memory giants and AI chip companies all gear up for the combat of next-gen high bandwidth memory (HBM), JEDEC, the leader in the development of standards for the microelectronics industry, revealed the preliminary specifications of HBM4 last week. According to its press release and a report from Wccftech, HBM4 is poised to deliver substantial memory capacities, with densities up to 32Gb in 16-Hi stacks.

According to JEDEC, HBM4 aims to boost data processing rates while preserving key features such as higher bandwidth, reduced power consumption, and increased capacity per die or stack, which are crucial traits for applications that demand efficient management of large datasets and complex calculations, such as generative AI, high-performance computing, high-end graphics cards, and servers.

According to JEDEC’s preliminary specifications, HBM4 is anticipated to feature a “doubled channel count per stack” compared to HBM3, which indicates a higher utilization area, leading to significantly enhanced performance. It is also worth noting that in order to support device compatibility, the new standard ensures that a single controller can work with both HBM3 and HBM4.

JEDEC notes that HBM4 will specify 24 Gb and 32 Gb layers, offering support for TSV stacks ranging from 4-high to 16-high. The committee has initially agreed on speed bins up to 6.4 Gbps, with ongoing discussions for higher frequencies.

Interestingly enough, JEDEC did not specify how HBM4 integrates memory and logic semiconductors into a single package, which would be one of the major challenges the industry has been eagerly trying to solve.

Earlier in June, NVIDIA announced its next-gen Rubin GPU, targeting to be released in 2026, will feature 8 HBM4, while its Rubin Ultra GPU will come with 12 HBM4 chips.

The roadmaps for memory giants on HBM4 is generally in accordance with NVIDIA’s product pipeline. Samsung, for instance, is said to be developing a large-capacity HBM4 memory with a single stack capacity of 48GB, which is expected to enter production in 2025.

The current HBM market leader, SK hynix, on the other hand, has collaborated with TSMC on the development and production of HBM4, scheduled for mass production in 2026.

Micron has also disclosed its next-generation HBM memory, tentatively named HBM Next. It is expected that HBM Next will offer capacities of 36GB and 64GB, available in various configurations.

Read more

(Photo credit: SK hynix)

Please note that this article cites information from JEDEC and Wccftech.

Get in touch with us