Major Cloud Service Providers (CSPs) continue to see an increase in demand for AI servers over the next two years. The latest projections of TrendForce indicate a global shipment of approximately 1.18 million AI servers in 2023, with a year-on-year growth of 34.5%. The trend is expected to persist into the following year, with an estimated annual growth of around 40.2%, constituting over 12% of the total server shipments.

NVIDIA, with its key products including AI-accelerating GPU and the AI server reference architecture HGX, currently holds the highest market share in the AI sector. However, it is crucial to monitor CSPs developing their own chips and, in the case of Chinese companies restricted by U.S. sanctions, expanding investments in self-developed ASICs and general-purpose AI chips.

According to TrendForce data, AI servers equipped with NVIDIA GPUs accounted for approximately 65.1% this year, projected to decrease to 63.5% next year. In contrast, servers featuring AMD and CSP self-developed chips are expected to increase to 8.2% and 25.4%, respectively, in the coming year.

Another critical application, HBM (High Bandwidth Memory), is primarily supplied by major vendors Samsung, SK Hynix, and Micron, with market shares of approximately 47.5%, 47.5%, and 5.0%, respectively, this year. As the price difference between HBM and DDR4/DDR5 is 5 to 8 times, this is expected to contribute to a staggering 172% year-on-year revenue growth in the HBM market in 2024.

Currently, the three major manufacturers are expected to complete HBM3e verification in the first quarter of 2024. However, the results of each manufacturer’s HBM3e verification will determine the final allocation of procurement weight for NVIDIA among HBM suppliers in 2024. As the verifications are still underway, the market share for HBM in 2024 remain to be observed.

Read more

• [News] Memory Titans Vie for Control in HBM Tech, Who Will Shape the Next-Gen?
• [Insights] NVIDIA Maintains Confidence Despite Export Restrictions, Continues Unveiling New Products

(Photo credit: NVIDIA)

The ongoing reduction in production by major manufacturers throughout this year has gradually restored balance to the market supply and demand. This is beneficial for chip manufacturers to regain control over prices. Signs of a bottoming out and rebound have emerged in the memory market in the third quarter of this year.

TrendForce data reveals that the overall price of DRAM has been declining since 4Q21 and only began to rebound in 4Q23, marking a total decline over 8 quarters. As for NAND Flash, the overall price started declining from 3Q22 and began to rebound from 3Q23, totaling a decline over 4 quarters.

However, despite the recovery in demand, achieving effective destocking and returning to a state of supply-demand equilibrium next year still heavily relies on suppliers exercising restraint in production capacity. If suppliers can control production capacity appropriately, there is a chance for the average memory prices to continue their rebound.

Read more

• [News] Market Anticipates a 50% Price Surge for NAND Flash in Short-Term
• [News] Improvement in Memory Inventory Leads to First Price Increase in Two and a Half Years

(Photo credit: Samsung)

Examining the dynamics of advanced semiconductor manufacturing, from research and development to the competition for cutting-edge equipment and securing orders, major players such as TSMC, Samsung, and Intel are constantly in action. Simultaneously, newcomer Rapidus is making a strong entrance. The competition for advanced processes is set to intensify in 2024.

Amidst the global chipmakers’ race to develop 2-nanometer processes, TSMC has once again emerged victorious by securing Apple’s order. The upcoming iPhone 17 Pro, expected to be released in 2025, reportedly will feature TSMC’s 2-nanometer chip. Samsung is also gearing up to launch a 2nm prototype in 2024, reportedly offering discounted prices with the aim of attracting customers such as NVIDIA.

However, industry insiders reveal that TSMC is on the verge of finalizing its clients for future 3nm and 2nm technologies, apart from Apple, AMD, NVIDIA, Broadcom, MediaTek, and Qualcomm are among the clients for TSMC’s 3nm and 2nm processes. The changes in the customer portfolio of TSMC, Samsung, and Intel in 2024 are bound to be the focal point throughout the year.

(Image: TSMC)

Amidst geopolitical influences, governments worldwide are enticing semiconductor manufacturers with subsidy policies, prompting chip manufactures to establish themselves in various regions. The ongoing dynamics of semiconductor facility construction and the evolving global production capacity remain focal points for the industry in 2024.

Following TSMC’s establishment of facilities in Arizona, USA, and Kumamoto, Japan, the progress of TSMC’s second Kumamoto plant has garnered significant industry attention. On another front, the developments at TSMC’s ESMC facility in Germany continue to capture global attention within the semiconductor industry.

Powerchip Semiconductor Corporation (PSMC) also made headlines in 2023 by announcing the construction of its first overseas 12-inch fab, JSMC, located in Sendai City, Miyagi Prefecture, Japan.

Meanwhile, Samsung’s overseas expansion efforts are equally robust. In addition to its Taylor plant in the United States, Samsung plans to establish a new semiconductor packaging research center in Japan.

According to TrendForce data, considering an equivalent foundry capacity of 12 inches, Taiwan held a global market share of approximately 47% in 2023, followed by China at 26%, South Korea at 12%, the United States at 6%, Singapore at 4%, Japan at 2%, Germany at 1%, and others at 2%. By 2027, Taiwan’s market share is projected to decrease to 42%, with China at 28%, South Korea at 10%, the United States at 7%, Singapore at 6%, Japan at 3%, Germany at 2%, and others at 1%.

(Image: TSMC)

After a rebound from the decline in NAND prices, the current quotations still show a gap from reaching the breakeven point for suppliers such as Samsung, Kioxia, SK Hynix, and Micron.

Major domestic players in the NAND Flash industry indicate that NAND Flash suppliers, driven by the goal of profitability, will continue to aggressively raise prices. It is anticipated that prices will need to increase by over 40% once again for major manufacturers to break even. To achieve profitability, future price hikes are expected to be at least 50% or even higher, according to Economic Daily News.

Looking at the global NAND Flash market share in 3Q23, according to a report from TrendForce, Samsung holds the leading position with a market share of 31.4%. The second position is held by the SK group, with a market share of 20.2%, followed by the U.S.-based Western Digital at third place with a market share of 16.9%. The Japanese company, Kioxia ranks fourth with a market share of approximately 14.5%.

The industry indicates that due to the lower profitability of NAND Flash compared to DRAM, international giants are actively reducing NAND Flash production.

Taking Samsung as an example, since September of this year, the reduction in NAND chip production has expanded to 50% of total capacity, focusing on products with stacked layers up to 128 layers. The goal is to accelerate destocking and stabilize prices, with plans to gradually increase prices in 2024.

TrendForce has indicated that following Samsung’s expansion of the production reduction to 50%, other suppliers are also maintaining a restrained wafer allocation strategy. After more than half a year of production reduction in some processes and capacities, there is a structural supply shortage, providing an advantage for chip manufacturers in price control. Observing the market in the fourth quarter, there are almost no low-priced sources available for purchase. However, buyers still tend to maintain high inventory levels and continue purchasing.

Industry sources revealed that the NAND chip prices had plummeted too deeply before. Although the quarterly increase in contract prices seems substantial, there is still a distance for chip manufacturers to achieve a turnaround. It is expected that prices need to increase by another 40% to allow suppliers to cross the breakeven point. Therefore, prices are expected to be quite strong in the coming quarters.

Read more

• NAND Flash Industry Revenue Grows 2.9% in 3Q23, Expected to Surge Over 20% in Q4, Says TrendForce
• [Insights] Memory Spot Price Update: Modest DRAM Increase; NAND Flash 512Gb Premium Fades

(Photo credit: Samsung)