Super Micro Computer, Inc. (Supermicro), a provider of servers and storage solutions, released its financial results for the fourth quarter of the fiscal year 2024 (ending June 30, 2024) on August 6. The revenue increased by 143.6% year-over-year (37.9% quarter-over-quarter) to USD 5.31 billion. The Non-GAAP diluted earnings per share (EPS) rose by 78.1% year-over-year (decreased by 6% quarter-over-quarter) to $6.25.

Supermicro forecasts that for the first quarter of the fiscal year 2025 (ending September 30, 2024), revenue will be between USD 6 billion and 7 billion (midpoint of USD 6.5 billion), and the Non-GAAP diluted EPS is expected to be between $6.69 and $8.27 (midpoint of $7.48).

Additionally, for the fiscal year 2025 (ending June 30, 2025), revenue is projected to be between USD 26 billion and 30 billion (midpoint of USD 28 billion). A report from MoneyDJ further cite sources, indicating that Supermicro’s fiscal year 2025 revenue is expected to reach USD 23.4 billion.

According to the Q4 financial report for the fiscal year 2024 released by Supermicro, the gross margin decreased from 17.0% in the same period last year to 11.2%, the lowest since the company started reporting quarterly results in May 2007 , and below the 15.5% reported in the third quarter of the fiscal year 2024.

Per wccftech’s report, the Super Micro earnings call marked the first opportunity to engage with a company integrated into NVIDIA’s AI ecosystem. Consequently, the company’s management faced numerous questions about potential GPU delays impacting its financial performance.

In response, Charles Liang, Supermicro’s Chief Executive Officer and Chairman of the Board, acknowledged that his company had heard about potential delays from NVIDIA.

However, he emphasized that Supermicro considers such delays as a normal possibility, noting that technology companies often experience slight advancements or postponements in their schedules.

In this instance, it seemed to Liang that NVIDIA had pushed out its timeline slightly, which he stated would not impact Supermicro’s ability to offer its customers new solutions like the H200 cooling system, given their extensive customer base. He concluded by saying that the overall impact of this delay on Supermicro should be minimal.

Read more

• [News] Foxconn Remains Unfazed Despite NVIDIA’s GB200 Delay, with Customers Aim to Secure Their Orders
• [News] Supermicro President Charles Liang Bullish on Direct Liquid Cooling, Targeting a 15% Market Share within Next Year

(Photo credit: Supermicro)

“The Dawn of Generative AI Has Come!” This new chapter in the course of human technological evolution was first introduced by NVIDIA’s founder, Jensen Huang. Qualcomm’s CEO, Cristiano Amon, also shares this optimism regarding generative AI. Amon believes this technology is rapidly evolving and being adopted for applications such as mobile devices. It is expected to have the potential to radically transform the landscape of the smartphone industry. Similarly, Intel has declared the arrival of the “AI PC” era, signaling a major shift in computing-related technologies and applications.

This year, AI is transitioning from cloud computing to on-premise computing. Various “AI PCs” and “AI smartphones” are being introduced to the market, offering a wide range of selections. The current year of 2024 is even being referred to as the “Year of AI PC,” with brands such as Asus, Acer, Dell, Lenovo, and LG actively releasing new products to capture market share. With the rapid rise of AI PCs and AI smartphones, revolutionary changes are expected to occur in workplaces and people’s daily lives. Furthermore, the PC and smartphone industries are also expected to be reinvigorated with new sources of demand.

An AI PC refers to a laptop (notebook) computer capable of performing on-device AI computations. Its main difference from regular office or business laptops lies in its CPU, which includes an additional neural processing unit (NPU). Examples of AI CPUs include Intel’s Core Ultra series and AMD’s Ryzen 8040 series. Additionally, AI PCs come with more DRAM to meet the demands of AI computations, thereby supporting related applications like those involving machine learning.

Microsoft’s role is crucial in this context, as the company has introduced a conversational AI assistant called “Copilot” that aims to seamlessly integrate itself into various tasks, such as working on Microsoft Office documents, video calls, web browsing, and other forms of collaborative activities. With Copilot, it is now possible to add a direct shortcut button for AI on the keyboard, allowing PC users to experience a holistic collaborative relationship with AI.

In the future, various computer functions will continue to be optimized with AI. Moreover, barriers that existed for services such as ChatGPT, which still require an internet connection, are expected to disappear. Hence, AI-based apps on PCs could one day be run offline. Such a capability is also one of the most eagerly awaited features among PC users this year.

Surging Development of LLMs Worldwide Has Led to a Massive Increase in AI Server Shipments

AI-enabled applications are not limited to PCs and smartphones. For example, an increasing number of cloud companies have started providing services that leverage AI in various domains, including passenger cars, household appliances, home security devices, wearable devices, headphones, cameras, speakers, TVs, etc. These services often involve processing voice commands and answering questions using technologies like ChatGPT. Going forward, AI-enabled applications will become ubiquitous in people’s daily lives.

Not to be overlooked is the fact that, as countries and multinational enterprises continue to develop their large language models (LLMs), the demand for AI servers will increase and thus promote overall market growth. Furthermore, edge AI servers are expected to become a major growth contributor in the future as well. Small-sized businesses are more likely to use LLMs that are more modest in scale for various applications. Therefore, they are more likely to consider adopting lower-priced AI chips that also offer excellent cost-to-performance ratios.

TrendForce projects that shipments of AI servers, including models equipped with GPUs, FPGAs, and ASICs, will reach 1.655 million units in 2024, marking a growth of 40.2% compared with the 2023 figure. Furthermore, the share of AI servers in the overall server shipments for 2024 is projected to surpass 12%.

Regarding the development of AI chips in the current year of 2024, the focus is on the competition among the B100, MI300, and Gaudi series respectively released by NVIDIA, AMD, and Intel. Apart from these chips, another significant highlight of this year is the emergence of in-house designed chips or ASICs from cloud service providers.

In addition to AI chips, the development of AI on PCs and smartphones is certainly another major driving force behind the technology sector in 2024. In the market for CPUs used in AI PCs, Intel’s Core Ultra series and AMD’s Ryzen 8000G series are expected to make a notable impact. The Snapdragon X Elite from Qualcomm has also garnered significant attention as it could potentially alter the competitive landscape in the near future.

Turning to the market for SoCs used in AI smartphones, the fierce competition between Qualcomm’s Snapdragon 8 Gen 3 and MediaTek’s Dimensity 9300 series is a key indicator. Another development that warrants attention is the adoption of AI chips in automotive hardware, such as infotainment systems and advanced driver assistance systems. The automotive market is undoubtedly one of the main battlegrounds among chip suppliers this year.

The supply chain in Taiwan has played a crucial role in providing the hardware that supports the advancement of AI-related technologies. When looking at various sections of the AI ecosystem, including chip manufacturing as well as the supply chains for AI servers and AI PCs, Taiwan-based companies have been important contributors.

Taiwan-based Companies in the Supply Chain Stand Ready for the Coming Wave of AI-related Demand

In the upstream of the supply chain, semiconductor foundries and OSAT providers such as TSMC, UMC, and ASE have always been key suppliers. As for ODMs or OEMs, companies including Wistron, Wiwynn, Inventec, Quanta, Gigabyte, Supermicro, and Foxconn Industrial Internet have become major participants in the supply chains for AI servers and AI PCs.

In terms of components, AI servers are notable for having a power supply requirement that is 2-3 times greater than that of general-purpose servers. The power supply units used in AI servers are also required to offer specification and performance upgrades. Turning to AI PCs, they also have higher demands for both computing power and energy consumption. Therefore, advances in the technologies related to power supply units represent a significant indicator this year with respect to the overall development of AI servers and AI PCs. Companies including Delta Electronics, LITE-ON, AcBel Polytech, CWT, and Chicony are expected to make important contributions to the upgrading and provisioning of power supply units.

Also, as computing power increases, heat dissipation has become a pressing concern for hardware manufacturers looking to further enhance their products. The advancements in heat dissipation made by solution providers such as Sunon, Auras, AVC, and FCN during this year will be particularly noteworthy.

Besides the aforementioned companies, Taiwan is also home to numerous suppliers for other key components related to AI PCs. The table below lists notable component providers operating on the island.

With the advent of generative AI, the technology sector is poised for a boom across its various domains. From AI PCs to AI smartphones and a wide range of smart devices, this year’s market for electronics-related technologies is characterized by diversity and innovation. Taiwan’s supply chain plays a vital role in the development of AI PCs and AI servers, including chips, components, and entire computing systems. As competition intensifies in the realm of LLMs and AI chips, this entire market is expected to encounter more challenges and opportunities.

Join the AI grand event at Computex 2024, alongside CEOs from AMD, Intel, Qualcomm, and ARM. Discover more about this expo! https://bit.ly/44Gm0pK

(Photo credit: Qualcomm)

According to a report from Economic Daily News citing The Wallstreet Journal, Apple is rumored to be developing its own AI chips tailored for data centers, which could potentially give the world’s top smartphone seller a crucial advantage in the AI arms race. The report, quoting sources familiar with the matter, stated that Apple has been working closely with its chip manufacturing partner TSMC to design and produce these chips in the primary stage. However, it is still unclear whether the final version has been produced yet.

It is suggested that Apple’s server chips may focus on executing AI models, particularly in AI inference, rather than AI training, where Nvidia’s chips currently dominate.

Over the past decade, Apple has gradually become a major player in chip design for products like iPhone, iPad, Apple Watch, and Mac. The latest project involving Apple chips for data center servers, internally named “Project ACDC” (short for Apple Chips in Data Center), will integrate Apple’s IC design capabilities into the operation of clients’ servers, sources said.

The project has been in operation for several years, though the timetable for launching this server chip remains unclear. Apple is expected to unveil more new AI products and AI-related updates at its Worldwide Developers Conference (WWDC) in June.

An Apple spokesperson declined to comment on the reported developments.

According to reports from Wccftech on April 23rd, Apple is said to be working on a self-developed AI server processor using TSMC’s 3-nanometer process, with plans for mass production expected in the second half of 2025.

Following the recent launch of the Arm-based PC platform processor Snapdragon X Elite, which received high market acclaim, Qualcomm is reportedly doubling down by venturing into server processors. This expansion is expected to further intensify the competition amid traditional server processor giants Intel and AMD.

According to a report from the global tech media Android Authority, following the launch of the Snapdragon X Elite/Plus processors, Qualcomm is internally developing a server processor with the codename SD1, featuring their custom Oryon cores.

Reportedly, Qualcomm’s next-generation server processor will be manufactured using TSMC’s 5-nanometer process (N5P), featuring 80 Oryon cores with a maximum clock speed of 3.8GHz, 16-channel DDR5 memory with a maximum transfer rate of 5600MHz, 70 PCIe 5.0 interface links, and support for CXL v1.1. It will use a 9470-pin LGA socket and support dual-socket server configurations.

Furthermore, the status of this project is currently unconfirmed, but Qualcomm partners reportedly received briefings about it at the end of 2021 and early 2022, aligning with previous rumors. This isn’t Qualcomm’s first foray into server processors; they previously launched the Arm-based Centriq series in 2017, which was discontinued a year later.

Read more

• [News] Qualcomm Advances into AI PC Market, Reportedly Adopting 4nm Process
• [News] Battle in AI PCs: Exploring Intel, AMD, and Qualcomm Chips’ AI Computing Power

(Photo credit: Qualcomm)

The GPU shortage issue has reportedly been alleviated. Per a report from Economic Daily News, it has led to a significant improvement in delivery times for major server brands like Dell. Delivery times have decreased from 40 weeks at the end of last year to a normal cycle of 8-12 weeks now, and sometimes even shorter.

Dell is reportedly capitalizing on the opportunities in artificial intelligence (AI), according to the same report citing Terence Liao, General Manager of Dell Taiwan, who indicated on April 9th that the company is experiencing strong server orders and demand in the Taiwanese market. This surge is primarily due to the robust AI needs within Taiwan’s corporate sector.

As for the previously challenging GPU shortage issue affecting the industry, delivery times have significantly improved this year following the expansion of CoWoS (Chip-on-Wafer-on-Substrate) capacity.

Terence Liao mentioned that towards the end of last year, there was indeed a tight supply of NVIDIA’s H100 GPUs, leading to Dell’s delivery times averaging around 40 weeks and competitors experiencing even longer delays of up to 52 weeks. However, starting from February this year, GPU supply has notably improved. For Dell in Taiwan specifically, delivery times have returned to a normal cycle of 8-12 weeks, and sometimes even shorter.

With the GPU shortage issue eased, Dell Taiwan openly acknowledges that they currently have a high volume of server orders and strong demand, largely driven by Taiwan’s enterprises seeking AI solutions. Terence Liao analyzed that, from the perspective of the Taiwan market, industries actively adopting AI include manufacturing, healthcare, government, finance, and telecommunications sectors.

As per Dell’s GenAI Pulse Survey, 78% of IT decision-makers express anticipation for AI-driven solutions to unleash potential within enterprises, viewing AI as a means to enhance productivity, streamline processes, and reduce costs.

Moreover, from a corporate budget perspective, the allocation for AI servers has increased from around 10% in the past to approximately 20% currently. This shift indicates a heightened commitment within the Taiwanese industry towards investing in AI.

Terence Liao emphasized that the demand for AI servers primarily comes from Cloud Service Providers (CSPs) and general enterprises. While CSPs still represent a significant portion of this demand, Dell is particularly pleased to see an increase in demand from general enterprises.

Previously, TrendForce underscores that the primary momentum for server shipments this year remains with American CSPs. However, due to persistently high inflation and elevated corporate financing costs curtailing capital expenditures, overall demand has not yet returned to pre-pandemic growth levels. Global server shipments are estimated to reach approximately. 13.654 million units in 2024, an increase of about 2.05% YoY. Meanwhile, the market continues to focus on the deployment of AI servers, with their shipment share estimated at around 12.1%.

Read more

• Global Server Shipments Expected to Increase by 2.05% in 2024, with AI Servers Accounting For Around 12.1%, Says TrendForce
• [News] SSD Prices Keep Rising

(Photo credit: Dell)