While still working in the final stage of HBM3e qualification with NVIDIA, Samsung Electronics is also advancing in the AI memory market with custom high bandwidth memory (HBM) solutions. According to reports by PassionateGeekz and China Flash Market, the memory giant is collaborating with major clients, such as AMD and Apple, to develop tailored HBM products, which are expected to be commercially available in the era of HBM4.
Citing Choi Jang-seok, head of Samsung’s new business planning team at memory division, the reports note that many customers of Samsung are switching from traditional, general HBM to customized products, as the latter promises better performance, power and area (PPA), while offering greater value than current options.
PassionateGeekz notes that at the Samsung Foundry Forum 2024 earlier this week, Choi further highlighted two forms of customized HBM Samsung has been developing. It is worth noting that Samsung is developing a large-capacity HBM4 memory with a single stack capacity of 48GB, which is expected to enter production in 2025.
On the other hand, Samsung also illustrated the innovation of the 3D stacking of HBM DRAM and customer-specific logic chips. By bypassing the interposer and base die required in the existing 2.5D packaging solution, the HBM chip can be directly integrated into the computing SoC in 3D. Samsung’s custom HBM, therefore, by eliminating intermediaries and substrates, can significantly reduce power and area.
TrendForce also observed that for HBM4, standard processes and capacities have been settled. The three major suppliers are in the development stage, with each buyer initiating custom requests. For future generations of HBM, new directions have been proposed, as HBM may no longer be just arranged next to the SoC main chip but could also stack directly on top of it.
While all the options are still under feasibility discussion and not finalized, TrendForce believes the future HBM industry will shift towards more customized production. Compared to other DRAM products, this approach aims to break away from the framework of commodity DRAM in terms of pricing and design, offering more specialized solutions.
Read more
(Photo credit: Samsung)