The shortage of advanced packaging production capacity is anticipated to end earlier than expected. Industry suggests that Samsung’s inclusion in providing HBM3 production capacity has led to an increased supply of memory essential for advanced packaging. Coupled with TSMC’s strategy of enhancing advanced packaging production capacity through equipment modifications and partial outsourcing, and the adjustments made by some CSP in designs and placing orders, the bottleneck in advanced packaging capacity is poised to open up as early as the first quarter of the upcoming year, surpassing industry predictions by one quarter to half a year, according to the UDN News.

TSMC refrains from commenting on market speculations, while Samsung has already issued a press release signaling the expansion of HBM3 product sales to meet the growing demand for the new interface, concurrently boosting the share of advanced processes.

Industry indicates that the previous global shortage of AI chips primarily resulted from inadequate advanced packaging capacity. Now the shortage in advanced packaging capacity is expected to end sooner, it implies a positive shift in the supply of AI chips.

Samsung, alongside Micron and SK Hynix, is a key partner for TSMC in advanced packaging. In a recent press release, Samsung underscores its close collaboration with TSMC in previous generations and the current high-bandwidth memory (HBM) technology, supporting the compatibility of the CoWoS process and the interconnectivity of HBM. Having joined the TSMC OIP 3DFabric Alliance in 2022, Samsung is set to broaden its scope of work and provide solutions for future generations of HBM.

Previously, the industry points out that the earlier shortage of AI chips stemmed from three main factors: insufficient advanced packaging capacity, tight HBM3 memory capacity, and some CSPs repeatedly placing orders. Now, the obstacles related to these factors are gradually being overcome. In addition to TSMC and Samsung’s commitment to increasing advanced packaging capacity, CSPs are adjusting designs, reducing the usage of advanced packaging, and canceling previous repeated orders – all of which are the key factors.

TSMC’s ongoing collaboration with OSATs(Outsourced Semiconductor Assembly And Test) to expedite WoS capacity expansion is gaining momentum. NVIDIA confirmed during a recent financial calls that it has certified other CoWoS advanced packaging suppliers’ capacity as a backup. Industry speculation suggests that certifying the capacity of other CoWoS suppliers for both part of the front-end and back-end production will contribute to TSMC and its partners achieving the target of reaching a monthly CoWoS capacity of approximately 40,000 pieces in the first quarter of the next year.

Furthermore, previous challenges in expanding advanced packaging production capacity, especially in obtaining overseas equipment, are gradually being overcome. With equipment optimization, more capacity is being extracted, alleviating the shortage of AI chip capacity.

(Image: Samsung)

Explore more

• • [News] Memory Titans Vie for Control in HBM Tech, Who Will Shape the Next-Gen?
  • [News] Samsung Boosts 2.5D Packaging Equipment to Compete for TSMC’s CoWoS Orders
  • [News] The Alliance among Apple, TSMC, and Amkor May Pose Challenges to Samsung’s Advanced Packaging Strategy

According to Economic Daily News’ report, after a prolonged period of economy downturn, the market has gradually become optimistic about memories. The effective production reduction by the top five memory manufacturers has led to an increase in memory prices.

This, in turn, has prompted downstream module manufacturers to actively increase their procurement efforts, resulting in shortages of certain products. Industry source indicates that manufacturers, including Samsung and Micron, are expressing intentions to raise prices.

Memory Manufacturers Keen to Raise Prices, Future Demand Monitoring Required

On December 7th, Western Digital had sent out price increase notifications to its customers. In the notification, Western Digital stated that the company would review hard drive product pricing weekly, anticipating a price increase in the first half of the coming year.

Regarding flash memory components, the company expects prices to cyclically increase over the next few quarters, with the cumulative increase likely surpassing 55% of current levels.

It’s worth noting that, at present, many in the industry are optimistic about the cessation and rebound of NAND chip prices. However, currently, suppliers are individually notifying customers of adjusted quotes. In this context, Western Digital has directly issued a price increase notice to customers, with an expected remarkable increase, marking the industry’s first comprehensive significant price hike.

Meanwhile, the latest financial reports of many companies in the memory industry chain show significant improvement compared to the previous period.

Samsung Electronics reported a net profit of KRW 5.5 trillion (approximately USD 4.17 billion) in Q3, transitioning from a loss to profitability. In early November, South Korean media Pulse, citing conversations with numerous insiders in the semiconductor industry, reported that as the Q4 inventory clearance phase nears its conclusion, Samsung is considering a sequential price increase of 20% for Q1 and Q2 of the coming year.

On December 11th, SSD controller chip manufacturer Phison announced its performance report for November, with consolidated revenue reaching NTD 5.407 billion (approximately USD 171.8 million), representing nearly a 5% monthly growth.

According to Phison, the total shipment volume of SSD controller chips continued to recover in November. Among them, the total shipment volume of PCIe SSD controller ICs is expected to grow by nearly 40% year-on-year, setting a new record for the same period in history. This further substantiates the news of a significant surge in the memory market.

In the latest financial report from memory module manufacturer ADATA, the company’s consolidated revenue for October was NTD 3.791 billion (approximately USD 120.4 million), reflecting a monthly increase of 13.43% and a year-on-year increase of 39.59%.

ADATA’s Chairman, Simon Chen, recently mentioned that they anticipate the completion of NAND Flash inventory clearance by the end of this year or the end of January next year. There is an expectation that both DRAM and NAND Flash may face supply shortages next year. 

In addition, DRAM manufacturer Nanya Technology observes a price increase in DDR5, while DDR4 prices have stabilized. There is an expectation of a slight improvement in DDR4 and DDR3 prices in the fourth quarter.

NAND Flash spot prices have surged since the end of September, driven by a collective production cut from suppliers. TrendForce analyst Avril Wu recently mentioned that Samsung’s production capacity has reduced by almost half from its peak, indicating that even cost-efficient manufacturers like Samsung can no longer endure losses. It is suggested that the average wafer price has likely passed its lowest point.

From the supply side, recent industry reports indicate that memory manufacturers are employing a “delaying tactic” in the supply of NAND Flash for the fourth quarter. Module manufacturers attempted to finalize orders for millions of chips in September, but memory manufacturers were reluctant to release the products, and even when they were willing, the quantities and prices were unsatisfactory. Meanwhile, Samsung is reportedly pausing quotations and shipments for NAND products.

Looking ahead to the fourth quarter, the estimated average selling price increase for all NAND Flash products is expected to reach 13%, with an overall quarter-over-quarter revenue growth rate of over 20% in the NAND Flash industry.

It is worth noting that according to TrendForce analyst Avril Wu, with demand not showing explosive growth, the market will be focused on three key considerations. First, after production cuts, the decline in memory manufacturers’ inventory levels has begun, but it remains to be seen whether inventory can continue to shift towards buyers.

Second, it is anticipated that memory manufacturers’ production capacity will slowly increase, and if the market warms up, an early resumption of capacity could lead to supply-demand imbalances again. Lastly, whether end-demand can meet expectations for a recovery, with a particular focus on the sustained orders related to AI, will be crucial.

Read more

• [News] NAND Flash Wafer Surges 25% in November – Continued Price Increases Depend on Manufacturers’ Expansion

(Photo credit: Samsung)

As per a report from Taiwan’s TechNews,” TSMC, Samsung, and Intel have been actively deploying Backside Power Delivery Network (BSPDN) strategies recently, and have announced plans to incorporate BSPDN into their logic chip development roadmap. For instance, Samsung intends to implement BSPDN technology in its 2-nanometer chips, a move unveiled at the VLSI Symposium in Japan.

According to imec, BSPDN aims to alleviate the congestion issues faced by front-end logic chips in later-stage processes. Through Design Technology Co-Optimization (DTCO), more efficient wire designs are achieved in standard cells, aiding in the downsizing of logic standard cell.

In essence, BSPDN can be seen as a refinement of chiplet design. The conventional approach, where logic circuits and memory modules are integrated, is transformed into a configuration with logic functions on the front and power or signal delivery from the back.

While the traditional method of front-side wafer power delivery achieves its purpose, it leads to decreased power density and compromised performance. Nevertheless, the new BSPDN technique has not yet been adopted by foundries.

Samsung claims that, compared to the conventional method, BSPDN reduces area by 14.8%, providing more chip space for additional transistors and improved overall performance. Wire lengths are also cut by 9.2%, reducing resistance, allowing greater current flow, and thereby lowering power consumption while enhancing power transmission efficiency.

In June of this year, Intel also introduced its BSPDN-related innovations under the name ‘PowerVia.’ Team Blue plans to utilize this approach in the Intel 20A process, potentially achieving a chip utilization rate of 90%.

Intel believes PowerVia will address interconnect bottlenecks in silicon architecture, enabling continuous transmission through backside wafer powering. The company anticipates incorporating this novel approach into its Arrow Lake CPUs slated for release in 2024.

Furthermore, according to Taiwan’s supply chain sources, TSMC remains on track to launch its 2-nanometer process in 2025, with mass production expected in the latter half of the year in Hsinchu’s Baoshan. The company’s N2P process, planned for 2026, will feature BSPDN technology.

(Photo credit: Samsung)

With the advancements in AIGC models such as ChatGPT and Midjourney, we are witnessing the rise of more super-sized language models, opening up new possibilities for High-Performance Computing (HPC) platforms.

According to TrendForce, by 2025, the global demand for computational resources in the AIGC industry – assuming 5 super-sized AIGC products equivalent to ChatGPT, 25 medium-sized AIGC products equivalent to Midjourney, and 80 small-sized AIGC products – would be approximately equivalent to 145,600 – 233,700 units of NVIDIA A100 GPUs. This highlights the significant impact of AIGC on computational requirements.

Additionally, the rapid development of supercomputing, 8K video streaming, and AR/VR will also lead to an increased workload on cloud computing systems. This calls for highly efficient computing platforms that can handle parallel processing of vast amounts of data.
However, a critical concern is whether hardware advancements can keep pace with the demands of these emerging applications.

HBM: The Fast Lane to High-Performance Computing

While the performance of core computing components like CPUs, GPUs, and ASICs has improved due to semiconductor advancements, their overall efficiency can be hindered by the limited bandwidth of DDR SDRAM.

For example, from 2014 to 2020, CPU performance increased over threefold, while DDR SDRAM bandwidth only doubled. Additionally, the pursuit of higher transmission performance through technologies like DDR5 or future DDR6 increases power consumption, posing long-term impacts on computing systems’ efficiency.

Recognizing this challenge, major chip manufacturers quickly turned their attention to new solutions. In 2013, AMD and SK Hynix made separate debuts with their pioneering products featuring High Bandwidth Memory (HBM), a revolutionary technology that allows for stacking on GPUs and effectively replacing GDDR SDRAM. It was recognized as an industry standard by JEDEC the same year.

In 2015, AMD introduced Fiji, the first high-end consumer GPU with integrated HBM, followed by NVIDIA’s release of P100, the first AI server GPU with HBM in 2016, marking the beginning of a new era for server GPU’s integration with HBM.

HBM’s rise as the mainstream technology sought after by key players can be attributed to its exceptional bandwidth and lower power consumption when compared to DDR SDRAM. For example, HBM3 delivers 15 times the bandwidth of DDR5 and can further increase the total bandwidth by adding more stacked dies. Additionally, at system level, HBM can effectively manage power consumption by replacing a portion of GDDR SDRAM or DDR SDRAM.

As computing power demands increase, HBM’s exceptional transmission efficiency unlocks the full potential of core computing components. Integrating HBM into server GPUs has become a prominent trend, propelling the global HBM market to grow at a compound annual rate of 40-45% from 2023 to 2025, according to TrendForce.

The Crucial Role of 2.5D Packaging

In the midst of this trend, the crucial role of 2.5D packaging technology in enabling such integration cannot be overlooked.

TSMC has been laying the groundwork for 2.5D packaging technology with CoWoS (Chip on Wafer on Substrate) since 2011. This technology enables the integration of logic chips on the same silicon interposer. The third-generation CoWoS technology, introduced in 2016, allowed the integration of logic chips with HBM and was adopted by NVIDIA for its P100 GPU.

With development in CoWoS technology, the interposer area has expanded, accommodating more stacked HBM dies. The 5th-generation CoWoS, launched in 2021, can integrate 8 HBM stacks and 2 core computing components. The upcoming 6th-generation CoWoS, expected in 2023, will support up to 12 HBM stacks, meeting the requirements of HBM3.

TSMC’s CoWoS platform has become the foundation for high-performance computing platforms. While other semiconductor leaders like Samsung, Intel, and ASE are also venturing into 2.5D packaging technology with HBM integration, we think TSMC is poised to be the biggest winner in this emerging field, considering its technological expertise, production capacity, and order capabilities.

In conclusion, the remarkable transmission efficiency of HBM, facilitated by the advancements in 2.5D packaging technologies, creates an exciting prospect for the seamless convergence of these innovations. The future holds immense potential for enhanced computing experiences.

Smart watch shipments reached 107 million units in 2021, surpassing the shipments of smart bands for the first time. Smart bands declined in 2021 with only 70.33 million units delivered. As branded manufacturers strengthen their investment in the smart watch market, market growth has accelerated. Due to the proximity of functional applications, the smart band market has been gradually supplanted by low-cost smart watch products. Therefore, driven by new products in 2022, the current forecast indicates that smart watch shipments will continue to grow in 2022, reaching 119 million units, for an annual growth rate of 11.4%. Smart band shipments are expected to decline to 55.18 million units and the gap between the two continues to widen. It is worth noting, although branded manufacturers are optimistic regarding the development of the smart watch market, in light of risks such as the COVID-19 pandemic, war, and inflation, continuing downward revisions of smart watch shipment volume in 2022 cannot be ruled out and annual growth rate may even fall below 5%.

The top five major manufacturers of smart watches are Apple, Samsung, Huawei, Xiaomi, and Garmin with a combined market share of 63%. Apple Watch shipments reached 36.6 million units in 2021, with an annual growth rate of 20%. Apple is optimistic regarding the market in 2022. On the one hand, the company believes that the Watch Series 8 can maintain the same consumer interest as the Watch Series 7. On the other hand, a wave of entry-level product replacements is expected with the launch of the second-generation Watch SE. Coupled with the launch of new Pro products, Apple believes that market demand in 2022 will surpass that in 2021 and shipment volume is expected to reach 43 million to 46 million units.

However, considering the negative economic impacts following the wake of the COVID-19 pandemic and inflation, 4Q22 holiday sales may not pan out as expected. Throwing in the wildcard of China’s lockdown strategy, production of new Apple Watches may be affected if lockdown measures reappear in 2H22, which will lead to a risk of further delays in shipments of new products, upsetting shipments in 2022. Therefore, shipments of Apple Watches are conservatively forecast to reach 39.1 million units in 2022.

Although Samsung began exploring the wearable device market very early, due to the small market size and the rapid growth of the smartphone market, smart watches were not the focus of Samsung’s product development at the time. This was true up until recent years. As the growth of smartphones slowed, Samsung has once again strengthened its distribution of other consumer electronics products which has led to continuous growth in Samsung Galaxy Watch shipments. In addition, since Huawei has been flattened by Sino-US trade friction, Samsung leaped to claim the number two spot in the smart watch market in 2021. Samsung smartwatch shipments are estimated to grow from 11.09 million in 2021 to 14.1 million units in 2022.

After Google officially acquired Fitbit, although Fitbit remains nominally an independent brand, internal reorganization is bound to be carried out considering this affords more efficient resource allocation, integrating the companies’ procurement, product development, etc. Google will have two smart watch brands, Fitbit and Pixel. In terms of high-end watches, the Pixel Watch is a flagship product positioned as an extension of the Pixel mobile phone and is primarily used in synergy with smart phone functionality. Therefore, the Pixel Watch uses the Samsung Exynos chip and it is expected to highlight the features of various apps in the Google Play Store. Since Fitbit was acquired by Google, it has become necessary to adjust unified strategy and integrate and reorganize resources. Although smart watch shipments resumed growth in 2021, there is some distance between leading brands. Fitbit Is expected to launch new products in 2H22. Google Pixel Watch is also expected to be launched in 2H22, so Google/Fitbit smart watch shipments are estimated to grow to 3.65 million units in 2022.

（Image credit: Pixabay）