According to a report from Reuters, it’s rumored that ByteDance, the parent company of TikTok, is collaborating with American chip designer Broadcom to develop an advanced AI processor, which could provide ByteDance with a steady supply of high-end chips.

On June 24th, Reuters’ report cited sources, stating that the 5nm Application-Specific Integrated Circuit (ASIC) being developed by the two companies will comply with U.S. export control regulations and will be manufactured by TSMC.

Since the introduction of advanced chip export controls by Washington in 2022, no public announcements have been made regarding the development of 5nm or more advanced chips in collaboration between Chinese and American companies.

The sources cited by the same report indicate that ByteDance’s collaboration with existing partner Broadcom can help reduce procurement costs and ensure a stable supply of high-end chips. However, TSMC will not start manufacturing this new chip this year. According to Reuters citing other sources, although the two companies have already begun the design process, they have yet reached the tape-out stage, which signifies the completion of the design phase and readiness for manufacturing.

Securing a reliable source of AI chips is crucial for ByteDance’s algorithms. In addition to TikTok, the company operates numerous popular apps, including “Doubao,” an AI chatbot service similar to ChatGPT. The report further suggests that ByteDance stockpiled a significant number of NVIDIA chips, including A100, H100, A800, and H800, ahead of the initial round of U.S. sanctions. In 2023, ByteDance allocated USD 2 billion for purchasing NVIDIA chips.

Per another previous report from Reuters, it indicated that in response to U.S. sanctions, some Chinese AI chip manufacturers decided to downgrade their self-designed processors to avoid being cut off from TSMC’s foundry services. Reportedly, MetaX and Enflame entrusted downgraded chip design schematics to TSMC late last year to comply with U.S. regulations. These two leading Chinese AI chipmakers had previously claimed that their chips could rival NVIDIA’s GPUs in performance.

The downgraded AI chips designed by NVIDIA specifically for the Chinese market, including the most advanced model “H20,” reportedly received a lackluster initial market response. Due to abundant supply and forced price reductions, currently, the H20 is reportedly cheaper than competing chips from Huawei. The chip is reportedly to be sold at approximately 100,000 yuan per unit, while Huawei 910B sold at over 120,000 yuan per unit.

A previous report by The Information also indicated that major tech companies such as Alibaba, Baidu, ByteDance, and Tencent have been instructed to reduce their spending on foreign-made chips like NVIDIA’s.

Read more

• [News] NVIDIA Reportedly Facing Price Cut Pressure of H20 Chip in China Amid Competition with Huawei

(Photo credit: Broadcom)

According to a report from Nikkei citing sources, memory giant Micron Technology is building a pilot production line for advanced high-bandwidth memory (HBM) in the United States and is considering producing HBM in Malaysia for the first time to capture more demand from the AI boom.

Reported on June 19, Micron is said to be expanding its HBM-related R&D facilities at its headquarters in Boise, Idaho, which include production and verification lines. Additionally, Micron is considering establishing HBM production capacity in Malaysia, where it already operates chip testing and assembly plants.

Nikkei’s report further noted that Micron’s largest HBM production facility is located in Taichung, Taiwan, where expansion efforts are also underway. Micron is said to have set a goal to triple its HBM market share to 24-26% by the end of 2025, which would bring it close to its traditional DRAM market share of approximately 23-25%.

Earlier this month, a report from a Japanese media outlet The Daily Industrial News also indicated that Micron planned to build a new DRAM plant in Hiroshima, with construction scheduled to begin in early 2026 and aiming for completion of plant buildings and first tool-in by the end of 2027.

Per industry sources cited by TechNews, Micron is expected to invest between JPY 600 to 800 billion in the new facility, located adjacent to the existing Fab15 facility. Initially, the new plant will focus on DRAM production, excluding backend packaging and testing, with a capacity emphasis on HBM products.

Micron, along with SK Hynix, has reportedly received certification from NVIDIA to produce HBM3e for the AI chip “H200.” Samsung Electronics has not yet received approval from NVIDIA; its less advanced HBM3 and HBM2e are currently primarily supplied to AMD, Google, and Amazon.

Read more

• [News] HBM Supply Shortage Prompts Micron’s Expansion, Expected Schedule in Japan and Taiwan Revealed
• [News] Micron Slightly Raises Capital Expenditure for 2024, HBM Expected to Further Drive Revenue Growth in 2025

(Photo credit: Micron)

As tech heavyweights eagerly pursue more market share in the AI sector, the battle for talents in the semiconductor industry has also heated up. According to the latest report by The Chosun Daily, citing LinkedIn data as of June 18, NVIDIA has become the hottest tech talent hub, not only drawing talents from semiconductor giants, but recruiting from memory companies in full swing.

According to the report, NVIDIA employs 89 former TSMC employees, while only 12 former NVIDIA employees have joined TSMC. Moreover, comparing with the number of former NVIDIA employees now at Samsung (278), there are 515 NVIDIA employees coming from Samsung Electronics, which indicates a significant talent migration to the GPU giant.

Regarding the talent war between NVIDIA and Intel, the former has attracted as many as 2,848 employees from Intel, whereas only 544 former NVIDIA employees have joined Intel.

NVIDIA also attracts talents with its charisma in AI from other memory giants. The LinkedIn data cited by the report shows that there are 38 NVIDIA employees previously with SK hynix, with none moving in the opposite direction. In addition, NVIDIA has attracted 159 employees from Micron, whereas only 38 former NVIDIA employees have joined Micron.

Interestingly enough, though Samsung lags behind in the competition with TSMC regarding the advanced nodes, it seems to be attractive to talents from the world’s largest foundry. Data show that there are 195 TSMC employees transitioning to Samsung, while only 24 former employees have joined TSMC.

An industry insider cited by the report observed that Korean semiconductor companies are vigorously recruiting for high-performance memory positions, such as those involving HBM. Moreover, a growing number of master’s and doctoral-level semiconductor experts in South Korea are joining the industry, showing a trend where talent moves from academia to local companies and then to international firms.

(Photo credit: NVIDIA)

Samsung Electronics’ management has made a significant decision to invest in graphics processing units (GPUs). According to a report from Business Korea reported on June 18th, while the details of Samsung’s GPU investment have not been disclosed, this decision is noteworthy as it differs from their usual focus on memory and foundry services.

Per Business Korea citing Samsung Electronics’ governance report, the management committee approved the “GPU Investment Proposal” in March. The committee includes senior executives such as Han Jong-Hee, head of the Device eXperience (DX) division, as well as the presidents of the Mobile Experience (MX) and Memory Business divisions. Reportedly, this marks the first time since the agenda items were made public in 2012 that Samsung has decided to invest in GPUs, sparking speculation that the company aims to enhance its competitiveness in the GPU sector.

Industry sources cited in the same report interpret this investment as an internal strategy for Samsung to leverage GPUs to innovate semiconductor processes, rather than to develop or manufacture GPUs. At the “GTC Conference” held in March 2024, Samsung announced its collaboration with NVIDIA to develop AI-based digital twins, aiming to achieve full automation of semiconductor plants by 2030.

Reportedly, Samsung’s newly constructed high-performance computing (HPC) center in Hwaseong was completed in April 2024. This center houses a vast array of servers and network equipment necessary for semiconductor design, indicating a significant investment in GPUs.

According to the report, Samsung’s newly constructed high-performance computing (HPC) center in Hwaseong was completed in April 2024. This center houses a vast array of servers and network equipment necessary for semiconductor design, indicating a significant investment in GPUs.

Per another report from Bloomberg on June 4th, NVIDIA CEO Jensen Huang, during a briefing at the COMPUTEX, told reporters that NVIDIA is evaluating HBM provided by both Samsung and Micron Technology. Huang mentioned that there is still some engineering work needed to be completed, expressing the desire for it to have been finished already.

As per Huang, though Samsung hasn’t failed any qualification tests, its HBM product required additional engineering work. When asked about Reuter’s previous report concerning overheating and power consumption issues with Samsung’s HBM, Huang simply remarked, “there’s no story there.”

Read more

• [News] Reasons for Samsung’s HBM Chips Failing Nvidia Tests Revealed, Reportedly Due to Heat and Power Consumption Issues
• [News] Samsung Reportedly Establishes New HBM Team, Looking to Improve AI Chip Yield

(Photo credit: Samsung)

According to a report from Commercial Times, the construction at TSMC’s advanced packaging plant (P1) in the Chia-Yi Science Park has been halted due to the discovery of suspected historical artifacts. In response, TSMC has promptly initiated preparations for its second plant (P2). TSMC stated that they will comply with regulations from the relevant authorities regarding the suspected archaeological site found on the Chia-Yi facility grounds.

The total developed area of the Chia-Yi Science Park is approximately 88 hectares, with TSMC’s two advanced packaging plants occupying 20 hectares. This is nearly 40% larger than the 14.3 hectares of the Zhunan packaging and testing plant. The planned area for the P1 plant is about 12 hectares, initially slated for completion by the end of 2026 and mass production by 2028. The discovery of the archaeological site has led to the early initiation of the P2 plant, raising concerns about potential impacts on the advanced packaging capacity plans.

The Southern Taiwan Science Park Administration and the Cultural and Tourism Bureau of Chiayi County both stated on June 17 that, in accordance with the Cultural Heritage Preservation Act, they submitted the case to the Chiayi County Cultural and Tourism Bureau for cultural heritage review on June 7. The review committee has principally agreed to proceed with the rescue excavation, which will be carried out in accordance with relevant regulations.

The Chia-Yi Science Park is a key hub for developing the Great Southern Technology Corridor. Besides providing backend CoWoS (Chip-on-Wafer-on-Substrate) packaging for TSMC’s 2nm process from its Kaohsiung plant, the Chia-Yi facility will further integrate advanced 3D packaging technology, SoIC (System-on-Integrated-Chips), highlighting its strategic importance.

As AI chips continue to evolve, the competition in advanced packaging remains fierce, with many clients eagerly anticipating developments.

TSMC’s advanced packaging capacity is scarce, with primary customer NVIDIA having the highest demand, occupying about half of the capacity, followed closely by AMD. Broadcom, Amazon, and Marvell have also expressed strong interest in using advanced packaging processes.

Per a report from global media outlet Wccftech, NVIDIA’s Rubin GPU is expected to adopt a 4x reticle design and utilize TSMC’s CoWoS-L packaging technology, along with the N3 process. Moreover, NVIDIA will use next-generation HBM4 DRAM to power its Rubin GPU.

Industry sources cited in Commercial Time’s report have indicated that by the end of next year, TSMC’s monthly CoWoS capacity will be increased to 60,000 wafers. With growing orders and a steep learning curve, the annual capacity is expected to surpass 600,000 wafers next year. As the semiconductor industry advances into the Angstrom Era, the gap in TSMC’s advanced packaging capacity will gradually widen. Whether the Chia-Yi plant can be completed by 2026 remains a critical focal point.

Read more

• [News] NVIDIA CEO Jensen Huang Announces the Latest Rubin Architecture – Rubin Ultra GPU to Feature 12 HBM4
• [News] AMD Unveils MI325X, Claiming 30% Faster Computing Power than NVIDIA’s H200

(Photo credit: TSMC)