As generative AI applications fuel the era of high computing power, Foxconn’s connector subsidiary FIT announced on March 25th a cross-industry collaboration with MediaTek. Together, they will develop next-generation high-speed connectivity solutions, specifically Co-Packaged Optics (CPO), aiming to capitalize on the booming silicon photonics market.

According to a report from Economic Daily News, FIT and MediaTek have previously collaborated as upstream and downstream partners, with FIT being a leading manufacturer of custom ASIC sockets and having significant capacity for cooperation with upstream IC design firms.

This collaboration may mark their first joint venture in developing next-generation optical communication products, aiming to create CPO high-speed connectivity solutions using ASIC platforms and silicon photonics technology.

Foxconn Group Collaborates with MediaTek Across Industries

Industry sources cited by the report suggest that traditional data center transmission occurs on PCBs, whereas the CPO architecture is situated on the substrate, integrating optical communication components with switch into a module installed in a slot. This configuration shortens data transmission paths, reducing transmission losses and power consumption.

With the commercialization of generative AI, large language models require extensive computation within data centers, demanding high transmission rates to enhance operational efficiency. Traditional data transmission methods face significant signal loss, prolonging model training times and increasing power consumption. Consequently, the emergence of new network communication technology, CPO, addresses these challenges.

FIT asserts that CPO represents the next-generation optical communication transmission architecture, capable of shortening transmission paths, reducing transmission losses and signal delays, thereby providing more robust connectivity for AI computing and applications. It can be combined with the company’s existing optical communication products of 800G and 1.6T, forging ahead with next-generation network communication technology.

Through collaboration with MediaTek, they aim to offer customers more diverse and efficient connectivity solutions, driving the development of the era of high computational power.

MediaTek, as per the report, emphasized its commitment to adopting the industry’s most advanced processes, packaging technologies, and architectures, providing customers with diverse ASIC design platforms.

This initiative aims to offer the latest and comprehensive solutions to the rapidly growing data center and server markets. Collaborating with FIT on CPO further enhances their ability to deliver next-generation high-speed transmission solutions, thereby creating new market opportunities for customers.

Read more

• [News] Silicon Photonics Reshapes the Future; TSMC, ASE Ready to Seize Market Share
• [News] Foxconn Capitalizes on AI Opportunities? Reportedly Looking at Apple’s AI Server Market, B200 Also Poised to Succeed

(Photo credit: Foxconn)

On March 25, the Semiconductor Equipment Association of Japan (SEAJ) disclosed its latest statistics.

The data revealed that in February 2024, the sales of Japanese semiconductor equipment (3-month moving average, including exports) reached JPY 317.418 billion, representing a growth of 7.8% compared to the same month last year. This also marked a second back-to-back month of growth, achieving the largest increase in 10 months (9.8% growth since April 2023).

Moreover, monthly sales crossed the 300 billion-yen threshold for the fourth consecutive month, hitting a new high over the 10 months (JPY 336.162 billion since April 2023).

Compared to the previous month, Japanese semiconductor equipment sales rose by 0.8%, marking the fourth consecutive month of monthly growth. In the cumulative period from January to February 2024, its sales stood at JPY 6,322.93 billion (+6.4% YoY), setting a new record high in the same period of previous years.

Semiconductor equipment manufacturers from Japan include Tokyo Electron (TEL), Advantest, Screen, Kokusai Electric, Hitachi High-Tech, Nikon, and Canon, etc.

Read more

• [News] Subsidies to TSMC from Japan and China Increase Over Fivefold Annually
• [News] Semiconductor Equipment Sales in Japan Reach Nearly JPY 3.3 Trillion in 2023

(Photo credit: SEAJ Official Website)

Intel, Qualcomm, Google, and other tech giants are reportedly joining forces with over a hundred startups to challenge NVIDIA’s dominance in the market, as per a report from Reuters. Reportedly, their goal is to collectively penetrate the artificial intelligence (AI) software domain, guiding developers to migrate away from NVIDIA’s CUDA software platform.

NVIDIA’s CUDA is a parallel computing platform and programming model designed specifically to accelerate GPU computing. It allows GPU users to fully leverage their chip’s computational power in AI and other applications. As per a previous report from TrendForce, since 2006, NVIDIA has introduced the CUDA architecture, nearly ubiquitous in educational institutions. Thus, almost all AI engineers encounter CUDA during their academic tenure.

However, tech giants are now reportedly aiming to disrupt the current status quo. According to a report from Reuters on March 25th, Intel, Qualcomm, and Google are teaming up to challenge NVIDIA’s dominant position. They plan to provide alternative solutions for developers to reduce dependence on NVIDIA, encourage application migration to other platforms, and thereby break NVIDIA’s software monopoly and weaken its market influence.

The same report from Reuters further indicated that several tech companies have formed the “UXL Foundation,” named after the concept of “Unified Acceleration” (UXL), which aims to harness the power of acceleration computing using any hardware.

The project plans to leverage Intel’s oneAPI technology to develop software and tools supporting multiple AI accelerator chips. The goal is to reduce the technical barriers developers face when dealing with different hardware platforms, streamline the development process, enhance efficiency, and accelerate innovation and application of AI technology.

Vinesh Sukumar, Head of AI and Machine Learning Platform at Qualcomm, stated, “We’re actually showing developers how you migrate out from an NVIDIA platform.”

Bill Magro, Head of High-Performance Computing at Google, expressed, “It’s about specifically – in the context of machine learning frameworks – how do we create an open ecosystem, and promote productivity and choice in hardware.” The foundation is said to aim to finalize technical specifications in the first half of this year and strives to refine technical details by the end of the year.

However, CUDA software has established a solid foundation in the AI field, making it unlikely to be shaken overnight. Jay Goldberg, CEO of financial and strategic advisory firm D2D Advisory, believes that CUDA’s importance lies not only in its software capabilities but also in its 15-year history of usage. A vast amount of code has been built around it, deeply ingraining CUDA in numerous AI and high-performance computing projects. Changing this status quo would require overcoming significant inertia and dependency.

Read more

• [News] NVIDIA’s EULA Amendments Tighten Grip, Suppressing Third-Party CUDA Emulation
• [Insights] Microsoft Unveils In-House AI Chip, Poised for Competitive Edge with a Powerful Ecosystem

(Photo credit: NVIDIA)

Apple is reportedly intensifying its AI efforts, with plans to collaborate with Baidu on the Chinese version of its iPhone 16 series this year, as per a report from Economic Daily News. The devices will feature Baidu’s developed Generative AI technology, thus sparking a new wave of AI server deployment by Baidu.

In China, due to official requirements, providing generative AI services to ordinary consumers requires prior approval and scrutiny from relevant authorities. Only Chinese companies like Baidu and Alibaba have been granted permission. Apple has chosen Baidu as its AI service partner in the Chinese market.

According to the aforementioned reports, Apple and Baidu have entered into negotiations, planning to integrate Baidu’s generative AI services into products such as the iPhone for sale in China. By incorporating a Chinese version of AI, Apple aims to enhance its competitive advantage in the Chinese market.

Inventec, a Taiwanese manufacturer, has had close collaboration with Baidu for 13 years in the field of customized server manufacturing, has jointly developed an AI computing platform. Serving as a key server manufacturing partner for Baidu’s “All in AI” strategy, Inventec plays a major role in Apple’s swift push into the Chinese AI market alongside Baidu.

Inventec has traditionally refrained from commenting on order dynamics and customer relationships, emphasizing instead the robust shipment momentum of AI servers this year. Shipments are expected to more than double compared to last year. With AI server revenue accounting for approximately 5% to 6% last year, it is projected to surpass 10% this year.

Sources cited by the same report from Economic Daily News are optimistic that with Baidu becoming a key partner for Apple in the China’s generative AI landscape, Inventec’s AI server shipment momentum is poised to amplify, benefiting from the opportunities brought by the collaboration between Apple and Baidu.

As per a previous report from TrendForce, Baidu’s foray into AI chips can be traced back to as early as 2011. After seven years of development, Baidu officially unveiled its self-developed AI chip, Kunlun 1, in 2018. Built on a 14nm process and utilizing the self-developed XPU architecture, Kunlun 1 entered mass production in 2020. It is primarily employed in Baidu’s search engine and Xiaodu businesses.

Read more

• [News] Apple Reportedly Places Large Orders for TSMC’s 3nm While Simultaneously Securing Significant Advanced Packaging Capacity
• [News] Boosting Sales? Rare Price Cuts on Apple China’s Official Website

(Photo credit: Apple)

Benefited from frequent orders from its top three clients, Apple, Intel, and AMD, strong momentum has reportedly been driven for TSMC’s 3-nanometer orders, as per a report from Economic Daily News. Anticipated to see sequential growth throughout the year, these orders are expected to remain robust until the end of the year, positioning TSMC as a leader in the semiconductor industry’s recovery.

TSMC has a longstanding policy of not commenting on customer order dynamics. However, it is cited in the report that in the fourth quarter of last year, 3-nanometer orders accounted for approximately 15% of its revenue. With the adoption of 3-nanometer production by major clients this year, revenue from 3-nanometer orders is expected to surpass 20%, becoming the second-largest revenue contributor, following only the 5-nanometer process.

Looking at the orders placed by the top three clients for the 3-nanometer process, Apple is set to introduce the A18 series processor in its iPhone 16 lineup this year. Additionally, the latest self-developed M4 chip for laptops will also be produced by TSMC using the 3-nanometer process, starting in the second quarter.

On the Intel side, the Lunar Lake central processor, graphics processor, and high-speed IO chip are all confirmed to begin mass production at TSMC in the second quarter. This marks Intel’s first instance of outsourcing its entire mainstream consumer platform chip series to TSMC, making it a significant new source of orders for TSMC’s 3-nanometer process this year.

AMD, on the other hand, is poised to unveil its new Zen 5 architecture platform under the code name “Nirvana” this year, expected to significantly enhance AI applications. Following its customary practice, AMD will utilize TSMC’s wafer foundry services, with production set to commence on the 3-nanometer process and an expected launch in the latter half of the year.

TSMC, reportedly, is expanding its production capacity for the 3nm family and advanced packaging this year to meet the large orders from major clients such as Apple, NVIDIA, and AMD in the coming years.

As per TrendForce’s data, the 3nm process alone contributed 6% to TSMC’s Q3 revenue, with advanced processes (≤7nm) accounting for nearly 60% of its total revenue.

Read more

• [News] Apple Reportedly Places Large Orders for TSMC’s 3nm While Simultaneously Securing Significant Advanced Packaging Capacity
• [News] TSMC Reportedly Attracts Influx of 3nm Customers, Predicts Production Capacity Utilization to Surge to 80% by Year-End

(Photo credit: TSMC)