News
In mid-August, TSMC had signed a contract with panel manufacturer Innolux to purchase its plant and facilities located in southern Taiwan, eyeing to further expand its advanced packaging capacity. According to a report by China Times, the fab, designated as the AP8 facility, is expected to start production in the second half of 2025.
More importantly, the fab will not only provide foundry services but also the eagerly needed capacity for advanced 3D Chip on Wafer on Substrate (CoWoS) IC packaging services, the report notes.
The move will be critical for TSMC to meet the surging demand for the advanced packaging capacity for AI servers, according to the report. Its future capacity will reportedly be nine times that of AP6, TSMC’s advanced packaging fab in Zhunan.
Outbidding Micron, TSMC secured the plant with a transaction value of NTD 17.14 billion, which is much lower than the rumored market price of over NTD 20 billion. Citing sources from the supply chain, the report suggests that the main reason TSMC acquired Innolux’s fab was to bypass the time-consuming environmental assessment process.
Unlike the advanced packaging fab in Chiayi, central Taiwan, which has to be started from scratch, the newly-acquired facility only requires internal modifications. Within a year, TSMC can finish the job of equipment installation, and begin the production afterwards.
Sources cited by the report note that orders for related equipment manufacturing are already underway, with deliveries expected starting in April next year. While the process of trial production may take an additional quarter, the AP8 facility is expected to start production in the second half of 2025.
During an investor conference in mid-April, TSMC Chairman C.C. Wei stated that he anticipates the company’s CoWoS capacity to more than double in both 2024 and 2025. He noted later in July that TSMC targets to reach the balance between supply and demand by 2026.
According to analysts cited by the report, TSMC’s CoWoS capacity, though still remains in short supply, could exceed 32,000 wafers per month by the end of this year. With the additional outsourced capacity, the total CoWoS capacity may approach 40,000 wafers per month. By the end of 2025, TSMC’s CoWoS monthly capacity is projected to reach around 70,000 wafers.
Citing remarks by Jun He, TSMC Vice President of Operations and Advanced Packaging Technology and Service, TSMC’s CoWoS capacity is expected to achieve a compound annual growth rate (CAGR) of over 50% from 2022 to 2026. The foundry giant will also accelerate its pace on constructing fabs, shortening the typical 3-to-5-year timeline to within 2 years to meet customer demand.
Read more
(Photo credit: TSMC)
News
Samsung has been strengthening its alliance regarding the semiconductor packaging technology, attempting to narrow the technological gap with TSMC, according to the latest report by Business Korea.
Citing industry sources, Business Korea noted that Samsung is expected to expand its 2.5D and 3D MDI (Multi Die Integration) Alliance to include 30 partners this year, an increase of 10 within just one year.
The MDI Alliance, launched by Samsung Electronics in June, 2023, was established to address the rapid growth in the chiplet market for mobile and HPC applications, in which Samsung will collaborate with its partner companies as well as major players in memory, substrate packaging and testing.
According to Samsung’s press release, the MDI Alliance leads innovation in stacking technology by forming a packaging technology ecosystem for 2.5D and 3D Heterogeneous Integration. Together with partners across the ecosystem, Samsung will provide a one-stop turnkey service to better support customers’ technological innovation.
As demands from AI and data centers have been heated up, stacking and combining different chips are viewed as more cost-effective and efficient than further reducing the circuit size within a chip, which makes 2.5D and 3D IC packaging technology coveted by tech giants like NVIDIA and AMD.
Business Korea further stated that while Samsung does benefit from offering a ‘one-stop’ solution that integrates foundry, HBM, and packaging, successful collaboration is crucial to address the various software challenges that arise from chip integration. That is to say, to overcome this challenge, Samsung has formed a coalition with design firms, post-processing companies, and EDA (Electronic Design Automation) tool providers.
On the other hand, TSMC, the current market leader in 2.5D IC and 3D IC packaging, announced the new 3Dblox 2.0 open standard and its major achievements of its Open Innovation Platform (OIP) 3DFabric Alliance in September, 2023, while AMD confirmed its collaboration with TSMC on 3D IC packaging for the GPU giant’s MI300 AI accelerators, according to a press release by TSMC.
Read more
(Photo credit: Samsung)
Insights
The semiconductor industry enters the era of integration. Various foundries are focusing on advanced packaging technologies, but the terminology surrounding advanced packaging can be daunting. This article aims to explain these terms in the simplest way possible.
According to a report from TechNews, currently, there are two main trends in advanced packaging: heterogeneous integration and chiplets.
In fact, the concept of “heterogeneous integration” has been developing for many years and is not exclusive to advanced packaging. It is not only used for the integration of heterogeneous chiplets but also for integrating other non-chip active/passive components into a single package, which is the technology commonly used in traditional Outsourced Semiconductor Assembly and Test Services(OSATs).
In the simplest terms, “heterogeneous integration” can be likened to building with large building blocks, while “advanced packaging” is akin to assembling with small building blocks. Some manufacturers, like traditional Outsourced Semiconductor Assembly and Test Services(OSATs), excel in stacking large blocks, such as logic circuits, radio frequency circuits, MEMS (Micro-Electro-Mechanical Systems), or sensors, onto a IC substrate. The stacking of these different large blocks represents the concept of heterogeneous integration.
On the other hand, some blocks are too small to stack effectively, requiring assistance from advanced packaging, typically provided by semiconductor foundries.
Advanced packaging also encompasses 2.5D packaging and 3D packaging. Using the metaphor of building blocks, the former involves horizontally stacking small building blocks on a interposer, while the latter involves vertically stacking small building blocks with interconnection facilitated through Through-Silicon Vias (TSVs), which are ultra-small building blocks.
It’s important to emphasize that stacking blocks is a conceptual representation, and the distinction between large and small blocks is relative. The analogy above refers to heterogeneous integration in traditional packaging, and heterogeneous integration in advanced packaging follows a similar concept, but with even smaller building blocks.
With this concept in mind, let’s discuss the applications of heterogeneous integration in advanced packaging:
Among the various packaging types, SoC (System On Chip) involves integrating different chips such as processors and memory, with different functions, redesigned and fabricated using the “same process,” integrated onto a single chip, resulting in a final product with only one chip.
On the other hand, SiP (System in Package) involves connecting multiple chips with “different processes” through “heterogeneous integration” technology, integrated within the same packaging module. Therefore, the final product will be a system with many chips on it, resembling the stacking of different-sized building blocks mentioned earlier.
Therefore, heterogeneous integration refers to integrating different and separately manufactured components (heterogeneous) into higher-level assemblies. These components include blocks of different sizes, such as MEMS devices, passive components, logic chips, and more.
However, at a certain point, for the sake of process development, researchers found that separating components at the right time might facilitate miniaturization. Hence, chiplet was born.
As demands for ICs become increasingly complex, the size of SoC chips continues to grow. However, cramming too many components onto a limited substrate poses significant challenges, including heightened process complexity and reduced yield.
Hence, the concept of chiplets emerged, advocating for the segmentation of SoC functionalities, such as data storage, computation, signal processing, and data flow management, into smaller individual chips. These chiplets are then integrated through packaging to form a interconnected network.
It’s worth noting that Chiplets are essentially chips, whereas SiP refers to the packaging format. Chiplet architecture enable the reduction of individual chip sizes, simplify circuit design, overcome manufacturing difficulties and yield issues, and offer greater design flexibility.
Among them, there are two integration methods for the chiplet mode: “Homogeneous Integration” and “Heterogeneous Integration”. In many cases, both integrations actually coexist.
Homogeneous Integration involves designing two or more chips and then using advanced chip integration techniques to combine them into a single chip. On the other hand, heterogeneous integration of chiplets involves integrating different types of logic chips, memory chips, etc., using advanced packaging techniques because different types of chips cannot be manufactured in the same process.
For example, Apple and TSMC’s collaboration on custom packaging technology, UltraFusion, connecting two M2 Max chips to introduce the M2 Ultra, falls under the category of homogeneous chiplet mode. At the same time, integrating CPU, AI accelerators, and memory into AI chips belongs to the heterogeneous mode, such as AMD’s launch of CCD (Core Chiplet Die) chiplet products in 2020, enhancing design flexibility.
Currently, advanced packaging can be broadly categorized into three main types: Wafer-Level Packaging (WLP), 2.5D Packaging, and 3D Packaging. Traditional packaging involves cutting wafers into chips before packaging, while advanced packaging entails packaging the silicon wafer before cutting, requiring subsequent stacking processes in fabs. Therefore, the technology is primarily the responsibility of fabs.
Traditional packaging involves cutting wafers into chips before packaging. Advanced packaging, starting from wafer-level packaging, involves packaging silicon wafers before cutting, and subsequent stacking requires wafer fabrication processes.
Therefore, this article will delve into advanced packaging technologies offered by the three major foundries, with a focus on 2.5D and 3D packaging.
To further explain using building blocks, the difference between 2.5D and 3DIC packaging lies in the “stacking method.”
In 2.5D packaging, processors, memory, or other chips are stacked horizontally on a silicon interposer using a flip-chip method, with micro bumps connecting different chip’s electronic signals. Through silicon vias (TSVs) in the interposer link to the metal bumps below, then packaged onto the IC substrate, creating tighter interconnections between the chips and the substrate.
In a side view, although the chips are stacked, the essence remains horizontal packaging, with the chips positioned closer together and allowing for smaller chip sizes. Additionally, this is a form of “heterogeneous integration” technology.
3D packaging involves stacking multiple chips (face down) together, directly using through-silicon vias to stack them vertically, linking the electronic signals of different chips above and below, achieving true vertical packaging. Currently, more and more CPUs, GPUs, and memories are starting to adopt 3D packaging technology.
Hybrid bonding is one of the die bonding techniques used in advanced chip packaging processes. One of the commercially available technologies in this domain is the “Cu-Cu hybrid bonding.”
In traditional wafer bonding processes, there are interfaces between copper and dielectric materials. With “Cu-Cu hybrid bonding,” metal contacts are embedded within the dielectric material. Through a thermal treatment process, these two materials are bonded together, utilizing the atomic diffusion of copper metal in its solid-state to achieve the bond. This approach addresses challenges encountered in previous flip-chip bonding process.
Compared to flip-chip bonding, hybrid bonding offers several advantages. It allows for achieving ultra-high I/O counts and longer interconnect lengths. By using dielectric material for bonding instead of bottom fillers, the cost of filling is eliminated.
Additionally, hybrid bonding results in minimal thickness compared to chip-on-wafer bonding. This is particularly beneficial for future developments in 3D packaging, where stacking multiple layers of chips is required, as hybrid bonding can significantly reduce the overall thickness.
As the semiconductor industry enters the “post-Moore’s Law era,” the development focus of advanced packaging is gradually shifting from 2D planar structures to 3D stacking and from single-chip designs to multi-chip configurations. Therefore, “heterogeneous integration” will play a crucial role in future advanced packaging.
Currently, prominent companies such as TSMC, Samsung, and Intel are intensifying their research and development efforts and capacity expansions in this field, introducing their innovative packaging solutions.
With ongoing technological advancements and innovations, advanced packaging and heterogeneous integration will play increasingly vital roles in propelling the semiconductor industry towards greater heights, meeting the complex and diverse demands of future electronic devices.
Read more
(Photo credit: Intel)
In-Depth Analyses
As semiconductor manufacturing processes evolve more gradually, 3D packaging emerges as an effective means of prolonging Moore’s Law and enhancing the computational prowess of ICs. Within the realm of 3D stacking technology, the Interuniversity Microelectronics Centre (imec) based in Belgium categorizes 3D integration technologies into four distinct types, each determined by different partitioning locations within a chip: 3D-SIP, 3D-SIC, 3D-SOC, and 3D-IC. Based on our previous discussion of 3D-SIP and 3D-SIC stacking, this article places a spotlight on the other two technologies: 3D-SOC and 3D-IC.
3D-SOC
A System on Chip (SOC) involves the redesign of several different chips, all fabricated using the same manufacturing process, and integrates them onto a single chip. 3D-SOC takes this concept to new heights by stacking multiple SOC chips vertically. The image below illustrates the transformation of a 2D System on Chip (2D-SOC), where circuits are redivided into blocks, and then stacked to form a 3D System on Chip (3D-SOC).
Source: imec
imec’s research team previously published a paper on IEEE, outlining the advantages of 3D-SOC and backside interconnects. This technology aims to achieve the integration of diverse chips in a heterogeneous system. By intelligently partitioning circuits, it significantly reduces power consumption and boosts computational performance. In comparison to the trending chiplet technology, 3D-SOC holds a competitive edge.
Eric Beyne, IMEC’s Vice President of Research and Project Director for 3D System Integration, pointed out, “Chiplets involve separately designed and processed chiplet dies. A well-known example are high-bandwidth memories (HBMs) – stacks of dynamic random access memory (DRAM) chips. This memory stack connects to a processor chip through interface buses, which limit their use to latency-tolerant applications. As such, the chiplet concept will never allow for fast access between logic and first and intermediate level cache memories.”
However, it’s essential to acknowledge that 3D-SOC technology comes with apparent drawbacks, primarily higher research and development costs and a longer development timeline compared to 3D-SIP technology. Nevertheless, as applications like AIGC, AR/VR, 8K, and others continue to drive the need for high-speed computing, chips are relentlessly progressing towards higher efficiency, lower power consumption, and smaller size. In this context, 3D-SOC technology will maintain its place in advanced packaging.
Backside Power Delivery Network (BSPDN)
The technology of Backside Power Delivery Network (BSPDN) represents a pivotal development in semiconductor manufacturing, offering several advantages, including more flexible circuit design, shorter metal wire lengths, and higher chip utilization. After transforming a 2D System on Chip (2D-SOC) into a 3D-SOC through layered stacking, the original back sides of the chips become the outer sides of the 3D-SOC. At this stage, the “freed-up” backside of the chips can be utilized for signal routing or as power lines for transistors, in contrast to traditional processes where wiring and power lines are designed on the front side of the wafer.
In the past, backside chips were merely used as carriers, but BSPDN technology allows for more space to be used for logic wafer design. According to simulation results, the transmission efficiency of backside PDN is seven times higher than traditional front-side PDN. Intel has also announced the introduction of this technology in the 20Å and 18Å processes.
To achieve BSPDN, a dedicated wafer thinning process (reducing it to a few hundred nanometers) is required, along with nanoscale through-silicon vias (nTSV) to connect backside power to the front-side logic chip.
Another key technology for BSPDN is the Buried Power Rail (BPR), a miniaturization technique that embeds wires beneath the transistors, with some inside the silicon substrate and others in shallow trench isolation oxide layers. BPR replaces power lines and ground lines under standard cells in traditional processes and further reduces the width of standard cells, mitigating IR voltage drop issues.
The diagram below illustrates BSPDN, where backside PDN’s metal wiring is connected to Buried Power Rails (BPR), and the backside of the chip (BS) is connected to the front side of the logic chip (FS).
Source: imec
3D-IC
The final category, 3D-IC, employs new 3D sequential technology (S3D) or Monolithic technology to vertically stack n-type and p-type transistors, forming a Complementary Field-Effect Transistor (CFET). This technology enables two transistors to be stacked and integrated into the size of a single transistor. This not only significantly increases transistor density but also simplifies the layout of CMOS logic circuits, enhancing design efficiency. As seen in the diagram below, n-type and p-type transistors are integrated vertically to form a CFET.
Source: imec
Nevertheless, the key challenge lies in how to vertically integrate each minuscule transistor and address heat dissipation issues under high-speed computing. Major manufacturers are still in the development phase, but the technology’s biggest advantage lies in achieving the highest component density and the smallest node width, even without nodes. With the continuous increase in demand for high-speed computing, 3D-IC technology is set to become a focal point in the industry’s development.
3D Stacking Leading the Global Semiconductor Advancement
imec has outlined a roadmap for 3D stacking, aiming to reduce pitch spacings and increase point density within unit areas. However, imec also emphasizes that the development of 3D packaging technologies does not follow a linear timeline, as depicted in the figure above, as there is no single packaging technology that can cater to all requirements.
With the rapid development of applications such as AIGC, AR/VR, 8K, 5G, and others, a significant demand for computing power is expected to persist. To overcome the bottlenecks in semiconductor process technology, countries worldwide are fully engaged in advanced packaging research, and 3D stacking undoubtedly takes the center stage as the elixir for Moore’s Law continuation.
Explore More
(Image: Samsung)