Although the demand for end products related to the stay-at-home economy slowed down as many countries saw rising vaccination rates and were partially lifting social distancing restrictions, the decline in foundry orders from this source was more than offset by the traditional peak season for smartphones, according to TrendForce’s latest investigations. At the same time, OEMs for notebook (laptop) computers, networking devices, automotive electronics, and IoT devices kept vigorously building up their inventories because the earlier capacity crunch in the foundry market was constraining them from reaching their shipment targets. Because of these developments, demand continued to outstrip supply in the foundry market during 3Q21. As for foundries, they have been gradually taking on new production capacity in the recent period and gaining from the ongoing rise in the ASP. Thanks to robust demand, new production capacity, and rising wafer prices, the quarterly total foundry revenue rose by 11.8% QoQ to reach a new record high of US$27.28 billion for 3Q21. This result indicated nine consecutive quarters of revenue growth.

Top four foundries posted double-digit revenue growth for 3Q21 due to peak season for smartphones; SMIC’s revenue growth was slightly limited by restrictions imposed on its capacity expansions

TSMC raised its quarterly revenue by 11.9% QoQ to US$14.88 billion as it benefited from the release of new iPhone models. The foundry remained firmly at the top of the ranking in 3Q21. Regarding TSMC’s revenue generation by node, the combined revenue share of the 7nm and 5nm nodes has already surpassed 50% and is still expanding thanks to continued demand for smartphone chips and HPC chips. Samsung raised its revenue by 11% QoQ to US$4.81 billion for 3Q21 and sat firmly in second place. The revenue growth was attributed to several factors. First, the releases of new smartphone models during the second half of the year has spurred the demand for SoCs and DDIs. Second, fab Line S2 in Austin has returned to its normal level of revenue contribution following the recovery from the winter storm that struck Texas in the earlier part of this year. Third, fab Line S5 in Pyeongtaek has activated its newly added production capacity. And finally, the revenue result for 2Q21 was a low base for comparison and thus led to a rather impressive performance for 3Q21.

UMC made significant gains in 3Q21 because the activation of new production capacity for its 28/22nm nodes led to an increase in wafer input for OLED driver ICs and other components. This also caused a rise in its blended ASP. UMC’s revenue went up by 12.2% QoQ to US$2.04 billion for 3Q21. With a growth rate that surpassed the top two ranking leaders, UMC retained third place by overtaking GlobalFoundries in the ranking for the first time in 1Q20, and its lead has been gradually widening since then. GlobalFoundries posted a QoQ increase of 12% in revenue to US$1.71 billion for 3Q21 and kept fourth place in the ranking. To address the worldwide chip shortage, GlobalFoundries has announced a series of capacity expansions and greenfield projects this year. Existing plants including Fab1 in Dresden and Fab8 in Malta (which is a town in the state of New York) will take on new production capacity. New plants will also be built in Singapore and Malta. It is worth noting that the capacity expansions and greenfield projects that GlobalFoundries has revealed so far for this year will be financed via a public-private partnership model. GlobalFoundries will be leveraging funding from governments and advance payments from its clients to reduce the pressure of rising capital expenditure and ensure that the new production capacity will operate at a high utilization rate in the future.

SMIC increased its revenue by 5.3% QoQ to US$1.42 billion for 3Q21 and was ranked fifth. Two reasons were behind the revenue growth. First, there is a stable level of demand for its PMICs, Wi-Fi chips, MCUs, and RFICs. Second, SMIC has been steadily raising wafer prices. It is also worth pointing out that SMIC has been adjusting its product mix and client base due to geopolitical factors. Growing consistently over the quarters, the share of Chinese clients in SMIC’s client base came to almost 70% in 3Q21. Under the impetus of the semiconductor policies of the Chinese government, SMIC will continue to give priority to the demand from domestic clients. Hence, the portion of foreign clients in its incoming orders will gradually shrink relative to that of domestic clients.

Second- and third-tier foundries posted higher revenue growth rates compared with first-tier counterparts because of strong demand for mature nodes

HuaHong Group posted a QoQ increase of 21.4% in revenue to US$799 million for 3Q21, thereby taking sixth place in the ranking. HuaHong continues to raise its ASP as it production capacity is expected to be fully loaded through the whole 2021. This development, together with the successful capacity expansion undertaken at its Fab7 in Wuxi, contributed to the above-expected revenue result for the foundry. PSMC’s revenue growth continued to pick up pace in 3Q21 thanks to the general rise in wafer prices and the robust demand for the main categories of chip products (e.g., DDIs, PMICs, CIS, and power discretes such as MOSFETs and IGBTs). PSMC raised its quarterly revenue by 14.4% QoQ to US$525 million and was ranked seventh.

After surpassing Tower Semiconductor in the ranking for the first time in 2Q21, VIS maintained its strong growth momentum by posting a QoQ increase of 17.5% in revenue to US$426 million in 3Q21 on account of several factors. First, VIS increased its products shipments through capacity expansion. Furthermore, VIS was able to optimize its product mix and raise its ASP. It secured eighth place in the ranking. Occupying ninth place in the ranking, Tower Semiconductor’s performance exceeded expectations for 3Q21 with its revenue climbing 6.9% QoQ to US$387 million. Tower’s revenue generation mainly benefited from the stable demand related to RF-SOI chips, industrial sensor chips, and PMICs.

Taking the tenth place in the ranking, DB HiTek registered a 15.6% QoQ increase in revenue to a record high of US$283 million for 3Q21 because of the rising ASP. In the past year, DB HiTek kept its capacity utilization rate at almost 100%. To raise its overall output, the foundry has decided to focus its expansion efforts on its existing wafer production lines. As a result, its production capacity has been increasing slightly since 2Q21. The additional production capacity will effectively contribute to its revenue generation in 4Q21.

Moving into 4Q21, although foundries have undertaken various capacity expansions and greenfield projects, their new production capacity that has been activated this year is already completely booked. The new fabs that foundries have announced will need some time to get built and fully set up, so the chip shortage on the whole will unlikely ease off anytime soon. On the demand side, sales have weakened a bit for TVs and other end products associated with the stay-at-home economy. However, the hardware and infrastructure demand related to 5G, Wi-Fi 6, and IoT continues to gain momentum. Moreover, OEMs for consumer electronics are still stocking up on components in preparation for the year-end holiday sales. Based on the latest examination of incoming foundry orders, TrendForce finds that foundries will continue to operate at fully-loaded capacity. Due to the undersupply situation, the overall ASP of the foundry market has also been climbing. Meanwhile, foundries have been optimizing their product mixes to boost their financial performances. Taking account of this and other aforementioned developments, TrendForce believes that revenue growth will continue for the top 10 foundries in 4Q21. However, 4Q21 will also see more moderate growth compared with the previous quarter because there is a shortage of peripheral ICs made using mature process nodes. Additionally, demand has slacked a bit for some SoC products.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

The growth of the NAND Flash market in 3Q21 was primarily driven by strong demand from the data center and smartphone industries, according to TrendForce’s latest investigations. More specifically, NAND Flash suppliers’ hyperscaler and enterprise clients kept up their procurement activities that began in 2Q21 in order to deploy products based on new processor platforms. Major smartphone brands, on the other hand, likewise expanded their NAND Flash procurement activities during the quarter as they prepared to release their new flagship models. As such, clients in both server and smartphone industries made significant contributions to the revenue growth of the NAND Flash industry for 3Q21. At the same time, however, suppliers also warned that orders from PC OEMs began showing signs of decline. On the whole, the industry’s quarterly total NAND Flash bit shipment increased by nearly 11% QoQ for 3Q21, and the overall NAND Flash ASP rose by nearly 4% QoQ for the same quarter. Thanks to rising prices and expanding shipments, the quarterly total NAND Flash revenue increased by 15% QoQ to a new record high of US$18.8 billion in 3Q21.

Moving into 4Q21, the impact of the ongoing component gaps has widened to numerous application segments of the NAND Flash market as the capacity crunch in the foundry market remains unresolved. Currently, NAND Flash components are in abundance relative to other kinds of key components. For OEMs and ODMs, the differences between the NAND Flash inventory level and the inventory levels of other components have been growing over the past several months. Therefore, they have to scale back orders and reduce stock for NAND Flash. As inventory adjustments are happening, NAND Flash contract prices will start to drop and thus bring about an end to the several quarters of strong revenue growth enjoyed by suppliers.

Samsung

Owing to procurement demand from hyperscalers and smartphone brands, the NAND Flash market generally remained in shortage in 3Q21, thereby driving up Samsung’s ASP by 10% QoQ. Even so, Samsung’s NAND Flash bit shipment increased by only about 5% QoQ due to weakening demand from PC OEMs and low inventory levels of certain other components carried by Samsung’s clients. Samsung’s NAND Flash revenue for 3Q21 reached US$6.51 billion, a 16.5% QoQ increase.

Kioxia

Although orders from PC OEMs began to wane, Kioxia still benefitted from orders from its major smartphone and data center clients in 3Q21, during which Kioxia’s NAND Flash bit shipment underwent a major QoQ increase exceeding 15%. As the NAND Flash market remained in a shortage situation, Kioxia’s ASP increased by about 4% QoQ, resulting in a revenue of US$3.64 billion, which represents a 20.8% QoQ increase and the highest single-quarter revenue in Kioxia’s history.

SK hynix

Among all NAND Flash suppliers in 3Q21, SK hynix registered the highest growth in bit shipment at more than 20% QoQ. This performance can be attributed to several reasons: the cyclical upturn in procurement activities from smartphone brands, persistently strong demand from the data center segment, and inventory-clearing by SK hynix in anticipation of weak demand in the upcoming off-season. Thanks to an ASP increase of about 5% QoQ, SK hynix’s NAND Flash revenue for 3Q21 reached US$2.54 billion, a 25.6% QoQ increase.

Western Digital

Although Western Digital’s PC OEM clients reduced their SSD orders due to supply chain disruptions, and demand from the retail end also remained weak, Western Digital was able to increase its NAND Flash bit shipment by 8% QoQ in 3Q21 due to enterprise SSD demand from the data center segment and NAND Flash demand from smartphone brands for the release of new smartphone models. Nevertheless, Western Digital’s ASP fell by 3% QoQ because the company increasingly focused on major clients and high-density products. Western Digital’s NAND Flash revenue for 3Q21 reached US$2.49 billion, a 2.9% QoQ increase.

Micron

Demand from the data center segment remained strong, and clients continued to adopt Micron’s 176L products. However, Micron’s shipment share in the smartphone market lagged behind that of other NAND Flash suppliers. Furthermore, its PC OEM clients were starting to be affected by the uneven supply of semiconductor chips. In light of these factors, Micron’s NAND Flash bit shipment increased by a modest 4% QoQ. On the other hand, the NAND Flash market remained in a severe shortage in 3Q21, thereby driving up Micron’s ASP by about 5% QoQ. Hence, Micron’s NAND Flash revenue for 3Q21 reached US$1.97 billion, an 8.8% QoQ increase.

Intel

Although persistently strong demand from the data center segment led to a massive price hike for enterprise SSDs and a nearly 6% increase in Intel’s ASP in 3Q21, the company was unable to fully meet its client demand since it could not procure sufficient upstream components. This lack of upstream components resulted in a severe decline of about 5% QoQ in Intel’s NAND Flash bit shipments and offset the upward momentum generated by an increase in Intel’s ASP. Intel’s NAND Flash revenue for 3Q21 reached a mere US$1.11 billion, a slight 0.6% QoQ increase.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

As the global vaccination rate rose, and border restrictions in Europe and North America eased, social activities also began to enter a period of recovery, with the consumer electronics market seemingly ready for the arrival of the traditional peak season in 2H21, according to TrendForce’s latest investigations. At the same time, however, the global supply chain was affected by delays in maritime transport, skyrocketing shipping costs, and component shortages, in addition to already-prohibitive price hikes for certain components in 1H21. Given the parallel rise in both material and manufacturing costs, the market for end products has not undergone the expected cyclical upturn in 2H21. Even so, the overall demand for and shipment of smartphones, notebook computers, and monitors experienced QoQ increases in 3Q21, thereby driving up businesses for major OSAT (outsourced semiconductor assembly and test) companies. For 3Q21, the revenues of the top 10 OSAT companies reached US$8.89 billion, a 31.6% YoY increase.

Certain major OSAT companies experienced a slight dip in their capacity utilization rates due to the ongoing shortage of key components including chips and substrates, as well as the electricity rationing that limited both energy intensity and energy consumption in Jiangsu, Zhejiang, and Guangdong at the end of September. Nevertheless, this dip has had virtually no impact on the OSAT industry because certain OSAT companies shifted their operations to substrate-less packaging technologies and reallocated the previously affected capacities. Hence, TrendForce is bullish on the performance of the OSAT industry in 4Q21.

Market leaders ASE and Amkor registered revenues of US$2.15 billion and US$1.68 billion, which represent YoY increases of 41.3% and 24.2%, respectively, for 3Q21. While both companies had some of their capacities hindered due to the shortage of chips, lead frames, and substrates, ASE had its lead times further extended given that its Suzhou-based fab was affected by China’s power rationing. Notably, as the demand for packaging and testing smartphone APs, network chips, and automotive chips remains strong in 4Q21, ASE and Amkor will continue to expand in the 5G, IoT, and AI end-product markets in 2022.

SPIL is currently aiming to strengthen the R&D operations for advanced packaging technologies at its new fab in Erlin, Changhua, since it will be unlikely to compensate for the loss of smartphone AP packaging business from Huawei in the short run. SPIL’s revenue for 3Q21 reached US$1.04 billion, a 15.6% YoY increase. While KYEC previously suffered lowered capacity utilization due to the COVID-19 pandemic, it has since made a gradual recovery and registered a revenue of US$323 million, a 28.5% YoY increase, for 3Q21, thanks to testing orders for 5G chips from Qualcomm and MediaTek. PTI, on the other hand, primarily benefitted from its DRAM packaging and testing business. The company posted a revenue of US$802 million, a 24.0% YoY increase, for 3Q21. Nonetheless, PTI’s memory packaging capacity will likely undergo a sharp decline going forward, as Intel gradually finalizes the sale of its Dalian fab to SK Hynix by 2025, and the agreement between Micron and PTI regarding the assembly and testing services PTI provides at Micron’s Xi’an fab expires in 2Q22. In response, PTI reallocated some capacities at its new fab in Hsinchu to other strategic priorities such as CIS packaging and FOPLP technologies in 3Q21.

Major Chinese OSAT companies JCET and Hua Tian continued to benefit from China’s pursuit of domestic semiconductor substitutes. The two companies expanded their supply of OSAT services for 5G smartphones, base stations, automotive chips, and consumer electronics. As a result, JCET and Hua Tian registered revenues of US$1.25 billion and US$502 million, representing YoY growths of 27.5% and 57.6%, respectively, for 3Q21. Owing to strong sales by its client AMD this year, TFME recorded a revenue of US$636 million, an impressive 59.8% YoY increase, which represents the highest revenue growth among the top 10 OSAT companies in 3Q21.

Although ChipMOS and Chipbond, which specialize in packaging and testing display panel driver ICs, were affected by the slight drop in small-sized TV panel shipment in 3Q21, they were able to compensate for this loss owing to the gradual increase in packaging and testing demand for such driver ICs as TDDI and DDI. This increase can primarily be attributed to the growing demand for mid- and large-sized TV panels, as well as the ramp-up of OLED smartphone panels, which certain smartphone models began to adopt. For 3Q21, ChipMOS and Chipbond grew their respectively revenue by 32.5% YoY and 29.5% YoY to about US$257 million and US$255 million. At the same time, as IC design companies from the upstream supply chain redirected certain orders to ChipMOS and Chipbond in response to China’s power rationing at the end of September, these two companies will likely reach new revenue records in 4Q21.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

DRAM buyers were aggressively stocking up during 1H21 because quotes began to rise at the start of the year, and there were concerns about shortages in the supply chain, according to TrendForce’s latest investigations. To avoid the risk of a supply crunch, most DRAM buyers kept raising their demand until the middle of the year. Moving into this second half of the year, the COVID-19 pandemic has exacerbated component gaps, the adverse effect of which on OEMs’ ability to assemble their end products has widened as well. Due to having a glut of memory and a shortage of other key components, some OEMs have opted to scale back DRAM procurement. PC OEMs have especially become noticeably restrained in this regard. Fortunately, the server-related segment of the market has been propping up the overall demand; and because of this, most DRAM suppliers were able to post a marginal growth in shipments for 3Q21. Additionally, quotes for DRAM product also kept rising in 3Q21. On account of these factors, the quarterly total DRAM revenue rose again by 10.2% QoQ to US$26.6 billion for 3Q21.

Regarding 4Q21, DRAM buyers that are already carrying a high level of inventory will probably adopt an even more conservative stance, as OEMs are still affected by component gaps in the supply chain while also preparing for stock-taking at the end of the year. Without adequate demand for support, DRAM prices on the whole are going to make a downward turn in 4Q21 and thereby end this short three-quarter period of cyclical price upturn. Also, since 4Q21 is going to be the first quarter in the general downtrend in quotes, buyers anticipate further price reductions in the future and are more reluctant to stock up in the near term. Declines in quotes will continue to widen as a result. With demand shrinking and prices falling, the DRAM industry will inevitably experience a drop in revenue as well.

DRAM suppliers saw higher profits in 3Q21 because of rising prices and growth in output shares of more advanced process technologies

Looking at the performances of individual DRAM suppliers for 3Q21, the three dominant suppliers all had positive revenue growth but diverged slightly in bit shipments. Samsung and Micron posted a small QoQ increase in their respective bit shipments, whereas SK hynix posted a small QoQ drop. The rise in quotes was able to offset the weakening momentum in bit shipments, so the top three suppliers managed to again raise their revenues from the previous quarter. Samsung’s, Sk hynix’s, and Micron’s QoQ revenue growth rates came to 11%, 8%, and 12% respectively. While their growth rates were still around the 10% level, they were more modest compared with the previous quarter. In the ranking by revenue market share, Samsung remained at the top with its market share expanding further to 44%. SK hynix and Micron were still at second and third place respectively. The former’s market share shrank a bit to 27.2% due to the decline in bit shipments, whereas the latter’s market share grew slightly to 22.9%.

In terms of profitability, 3Q21 saw continuing improvements thanks to rising quotes and growth in the output shares of the more advanced process technologies. Samsung raised its operating margin to 53% in 3Q21 as the share of 1Z nm products in its output kept growing. As such, Samsung’s operating margin reached almost to the high of nearly three years ago. Likewise, SK hynix’s operating margin grew to 47% in 3Q21 because of the increase in the output share of 1Z nm products. As for third-largest supplier Micron, the increase in its ASP for its latest fiscal quarter (June to August) is similar to the increases in the two South Korean suppliers’ respective ASPs for 3Q21. Its operating margin also rose to 42% for this period. Moving into 4Q21, TrendForce expects the slide in DRAM prices to be an inescapable trend. Whether individual suppliers will be able to maintain a high level of profitability depends on their own progress in process migration and yield rate improvement.

While the specialty DRAM market weakened in 3Q21, Taiwanese suppliers trailed closely behind the three dominant suppliers

Compared with mainstream DRAM products, specialty DRAM underwent a higher magnitude of price hikes in 1H21. Hence, as demand for TVs and other consumer electronics fell in 3Q21, and supply chain disruptions persisted, clients in turn reduced their DRAM procurement. This reduced demand indirectly impacted the revenue performances of Taiwanese suppliers, which primarily target the consumer electronics market. Nanya Tech continued to raise its quarterly ASP in order to offset weak shipment. The company’s revenue increased by about 6% QoQ in 3Q21, while its operating profit margin also increased from 31.2% in 2Q21 to 38.1% in 3Q21 due to the price hike. Winbond benefitted from high demand for its low-density (1/2Gb) products and recorded a nearly 13% QoQ increase in DRAM revenue in 3Q21. Among all Taiwanese suppliers, Winbond registered the strongest revenue growth during the quarter.

Nevertheless, TrendForce’s investigations also find that the physical spaces within the two aforementioned Taiwanese suppliers’ fabs are now fully occupied, meaning the suppliers are unable to install additional equipment in these fabs before building new fabs. Hence, these suppliers’ financial performances will be heavily impacted by their ASPs in the short run. For instance, Nanya Tech’s new facilities will not contribute to DRAM production until construction finalizes in 2024. In the short run, Nanya Tech is able to slightly increase its DRAM bit shipment only through migrating to the advanced 1A/1B nm process technologies. Similarly, Winbond will be able to continue expanding its production capacity only after its new fab located in Luzhu, Kaohsiung kicks off mass production in 2H22. As for PSMC, its revenue from sales of PC DRAM products manufactured in-house increased by about 6% QoQ in 3Q21. However, PSMC’s total revenue from both sales of in-house DRAM and its DRAM foundry business increased by 12% QoQ in 3Q21.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

According to TrendForce’s latest report on the server industry, not only have emerging applications in recent years accelerated the pace of AI and HPC development, but the complexity of models built from machine learning applications and inferences that involve increasingly sophisticated calculations has also undergone a corresponding growth as well, resulting in more data to be processed. While users are confronted with an ever-growing volume of data along with constraints placed by existing hardware, they must make tradeoffs among performance, memory capacity, latency, and cost. HBM (High Bandwidth Memory) and CXL (Compute Express Link) have thus emerged in response to the aforementioned conundrum. In terms of functionality, HBM is a new type of DRAM that addresses more diverse and complex computational needs via its high I/O speeds, whereas CXL is an interconnect standard that allows different processors, or xPUs, to more easily share the same memory resources.

HBM breaks through bandwidth limitations of traditional DRAM solutions through vertical stacking of DRAM dies

Memory suppliers developed HBM in order to be free from the previous bandwidth constraints posed by traditional memory solutions. Regarding memory architecture, HBM consists of a base logic die with DRAM dies vertically stacked on top of the logic die. The 3D-stacked DRAM dies are interconnected with TSV and microbumps, thereby enabling HBM’s high-bandwidth design. The mainstream HBM memory stacks involve four or eight DRAM die layers, which are referred to as “4-hi” or “8-hi”, respectively. Notably, the latest HBM product currently in mass production is HBM2e. This generation of HBM contains four or eight layers of 16Gb DRAM dies, resulting in a memory capacity of 8GB or 16GB per single HBM stack, respectively, with a bandwidth of 410-460GB/s. Samples of the next generation of HBM products, named HBM3, have already been submitted to relevant organizations for validation, and these products will likely enter mass production in 2022.

TrendForce’s investigations indicate that HBM comprises less than 1% of total DRAM bit demand for 2021 primarily because of two reasons. First, the vast majority of consumer applications have yet to adopt HBM due to cost considerations. Second, the server industry allocates less than 1% of its hardware to AI applications; more specifically, servers that are equipped with AI accelerators account for less than 1% of all servers currently in use, not to mention the fact that most AI accelerators still use GDDR5(x) and GDDR6 memories, as opposed to HBM, to support their data processing needs.

Although HBM currently remains in the developmental phase, as applications become increasingly reliant on AI usage (more precise AI needs to be supported by more complex models), computing hardware will then require the integration of HBM to operate these applications effectively. In particular, FPGA and ASIC represent the two hardware categories that are most closely related to AI development, with Intel’s Stratix and Agilex-M as well as Xilinx’s Versal HBM being examples of FPGA with onboard HBM. Regarding ASIC, on the other hand, most CSPs are gradually adopting their own self-designed ASICs, such Google’s TPU, Tencent’s Enflame DTU, and Baidu’s Kunlun – all of which are equipped with HBM – for AI deployments. In addition, Intel will also release a high-end version of its Sapphire Rapids server CPU equipped with HBM by the end of 2022. Taking these developments into account, TrendForce believes that an increasing number of HBM applications will emerge going forward due to HBM’s critical role in overcoming hardware-related bottlenecks in AI development.

A new memory standard born out of demand from high-speed computing, CXL will be more effective in integrating resources of whole system

Evolved from PCIe Gen5, CXL is a memory standard that provides high-speed and low-latency interconnections between the CPU and other accelerators such as the GPU and FPGA. It enables memory virtualization so that different devices can share the same memory pool, thereby raising the performance of a whole computer system while reducing its cost. Hence, CXL can effectively deal with the heavy workloads related to AI and HPC applications.

CXL is just one of several interconnection technologies that feature memory sharing. Other examples that are also in the market include NVLink from NVIDIA and Gen-Z from AMD and Xilinx. Their existence is an indication that the major ICT vendors are increasingly attentive to the integration of various resources within a computer system. TrendForce currently believes that CXL will come out on top in the competition mainly because it is introduced and promoted by Intel, which has an enormous advantage with respect to the market share for CPUs. With Intel’s support in the area of processors, CXL advocates and hardware providers that back the standard will be effective in organizing themselves into a supply chain for the related solutions. The major ICT companies that have in turn joined the CXL Consortium include AMD, ARM, NVIDIA, Google, Microsoft, Facebook (Meta), Alibaba, and Dell. All in all, CXL appears to be the most favored among memory protocols.

The consolidation of memory resources among the CPU and other devices can reduce communication latency and boost the computing performance needed for AI and HPC applications. For this reason, Intel will provide CXL support for its next-generation server CPU Sapphire Rapids. Likewise, memory suppliers have also incorporated CXL support into their respective product roadmaps. Samsung has announced that it will be launching CXL-supported DDR5 DRAM modules that will further expand server memory capacity so as to meet the enormous resource demand of AI computing. There is also a chance that CXL support will be extended to NAND Flash solutions in the future, thus benefiting the development of both types of memory products.

Synergy between HBM and CXL will contribute significantly to AI development; their visibility will increase across different applications starting in 2023

TrendForce believes that the market penetration rate of CXL will rise going forward as this interface standard is built into more and more CPUs. Also, the combination of HBM and CXL will be increasingly visible in the future hardware designs of AI servers. In the case of HBM, it will contribute to a further ramp-up of data processing speed by increasing the memory bandwidth of the CPU or the accelerator. As for CXL, it will enable high-speed interconnections among CPU and other devices. By working together, HBM and CXL will raise computing power and thereby expedite the development of AI applications.

The latest advances in memory pooling and sharing will help overcome the current hardware bottlenecks in the designs of different AI models and continue the trend of more sophisticated architectures. TrendForce anticipates that the adoption rate of CXL-supported Sapphire Rapids processors will reach a certain level, and memory suppliers will also have put their HBM3 products and their CXL-supported DRAM and SSD products into mass production. Hence, examples of HBM-CXL synergy in different applications will become increasingly visible from 2023 onward.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com