Just as generative AI is revolutionizing industries worldwide today by creating new opportunities, the concept of the Metaverse in 2021 was similarly embraced by technology giants as a strategic goal and vision for the future of the entire tech sector.

Microsoft, for instance, targeted the corporate segment of the Metaverse, showcasing the use of its mixed reality (MR) device, HoloLens 2, in manufacturing operations. NVIDIA introduced the Omniverse platform for image simulation, thereby facilitating the development of virtual environments within the Metaverse. There were also rumors about Google and Apple launching new virtual reality (VR) head-mounted devices. Perhaps most notably, Facebook’s name change to Meta was a clear indication of its commitment to this emerging field.

As Hype Fades, More Hardware and Content Are Needed to Strengthen the Foundation of the Metavers

Despite initial market optimism, the reality was that wearable technology had not reached maturity, and the quality of virtual content experiences fell short of expectations. As a result, there was insufficient momentum to drive the Metaverse forward in subsequent market developments. Many tech companies established departments dedicated to the Metaverse, but due to lackluster results and issues with resource allocation, these departments often faced workforce reductions, downsizing, or even complete dissolution.

Declining enthusiasm for the Metaverse primarily stems not from a flaw in the idea of blending virtual and real worlds, but from the grandiosity of its concept. The essence of Industry 4.0, after all, revolves around enhancing production efficiency through the data-driven integration of physical and digital realms.

This is a proven approach. Nevertheless, the challenge with the Metaverse lies in its ambitious scale. Without adequate software and hardware support, efforts to expand and implement it often fall short, yielding minimal benefits and, thus, diminishing its commercial appeal.

Essentially, the widespread adoption of technologies like head-mounted devices and a rich content library are vital for industry growth. In response, companies that develop VR and augment reality (AR) in recent years have pivoted their focus from the broader environmental framework towards improving wearable devices and creating engaging content. In doing so, they aim to boost the practical value of adopting VR and AR.

From Virtual Interaction to Spatial Computing, the Scope of Applications for Head-mounted Devices Continues to Expand

In 2023, according to TrendForce’s analysis, Meta’s Quest series dominated the global VR and MR device market, securing nearly 70% of total device shipments. This significant market share places Meta at the forefront, with Sony’s PS VR series ranking second, followed by other manufacturers like PICO and HTC. Entering the fray in 2024, Apple introduced its Vision Pro, which is expected to claim a 6% share of the global market.

Meta’s latest offering, the Quest 3, has adopted pancake lenses that enhance image clarity while slimming down the device’s profile. It is powered by the Qualcomm Snapdragon XR2 Gen 2, a (SoC) tailored for head-mounted devices that significantly boosts GPU and AI processing capabilities.

The Quest 3 marks a pivotal shift for Meta from VR to MR. Equipped with dual front-facing RGB cameras and advanced features like depth projection and room mapping, the Quest 3, alongside the higher-end Quest Pro, supports a range of MR applications. Additionally, the tracking capabilities of the Quest 3 are augmented by computer vision and machine learning technologies. With Meta’s ongoing collaboration with LG on new product development, the focus is now on extended reality (XR) applications linked with the television ecosystem.

Apple’s Vision Pro, which was launched in February 2024, has reignited market interest in VR.

This device fills a previously unaddressed gap in Apple’s portfolio by offering a VR head-mounted device that integrates seamlessly with iPhones, iPads, and other devices within Apple’s ecosystem, thereby enabling functions like image and video projection onto larger screens. The introduction of the Vision Pro brought the concept of spatial computing into the limelight, enabling users to interact with virtual objects in a natural and intuitive way and thus infusing fresh perspectives into the industry.

Moreover, at CES 2024, Sony unveiled an XR head-mounted device dubbed a “spatial content creation system.” Like the Apple Vision Pro, this device leverages the advantages of spatial computing. It’s designed as a commercial tool for developing 3D content, offering users precise and intuitive control over virtual objects, thereby simplifying the process of creating 3D models.

From Taiwan, ASUS has recently introduced its first AR glasses, the AirVision M1. These glasses are designed to function as a secondary screen, ideal for use outdoors or in situations where extra screens are necessary at home.

Taiwan-based Companies Expand into the Supply Chain for Headsets, Focusing on Optics, Chips, and Assembly

TrendForce analyst P. K. Tseng said that a critical aspect of the transformation for VR head-mounted devices is the increasing need for key components that are lighter and more compact, particularly pancake lenses, which are gaining importance due to their contribution to volume reduction.

However, the technological complexity and higher cost of manufacturing these advanced optical components mean that suppliers, such as GSEO and Young Optics, are relatively limited. This presents a blue ocean market opportunity, likely attracting more manufacturers to develop pancake lens components.

Furthermore, the trend is expected to drive demand for smaller-sized panels. While mainstream LCD panels continue to be widely used, the advent of devices like the Apple Vision Pro is anticipated to increase the adoption rate of Micro OLED panels.

Additionally, as standalone virtual devices become more mainstream in product design, and as the need for processing large volumes of image and sensor data independently by SoCs grows, demand will rise for dedicated chips used in VR and AR devices. For instance, MediaTek is rumored to be developing an exclusive AR chip for Meta.

System or device assembly is a key area of focus for Taiwan-based companies, particularly evident in the efforts of major ODMs like Quanta and Foxconn. These companies are enhancing their VR and AR hardware manufacturing through various strategies, including partnerships, mergers and acquisitions, and investment initiatives.

In the VR device supply chain, the strength of system assemblers lies in their ability to offer comprehensive product solutions, which expands the options available to prospective clients. The assembly of VR and AR devices presents unique challenges due to the necessity for high-quality image rendering and real-time motion capture. Numerous components are involved in the process.

Not all VR and AR device brands can develop head-mounted devices completely in-house, as demonstrated by companies like Meta and Sony. For newer market entrants, securing a comprehensive product solution that allows for future customization is a more desirable strategy. This demands that system assemblers have significant expertise in relevant technologies and ODM capabilities. As such, as opportunities in the VR and AR market continue to emerge, these assemblers are well-prepared to offer solutions for head-mounted devices.

Generative AI and Added-Value from Applications Will Sustain Future Growth Momentum

Beyond hardware, the focus on creating more content and valuable applications will be a major topic in the next phase of VR industry’s development, with generative AI poised to play a pivotal role.

Taking gaming as an example, VR game development is known to be exceedingly time-consuming, requiring developers to dedicate substantial amounts of time to coding. As a result, the games often lack diversity, customization, and meaningful game mechanics.

However, leveraging generative AI can expedite the game development process without sacrificing quality or increasing costs. Recent market analyses suggest that the adoption of generative AI could significantly reduce the time required to create XR learning modules from the 5-10 days typically seen in 2021 to less than 30 minutes today.

Consequently, major game engine providers like Unity are seizing this business opportunity. In mid-2023, Unity introduced a suite of generative AI development solutions tailored for VR game production. These solutions can be employed to create characters, objects, assets, and sound effects, thus significantly reducing development costs.

According to TrendForce’s research, global shipments of VR head-mounted devices are projected to register a slight year-on-year drop of 1.8%, but the annual total is still expected to surpass 9.3 million units.

Furthermore, with the releases of many new products ranging from chips and peripherals to complete systems, many of which were showcased at this year’s CES and MWC, there is strong bullish sentiment regarding the development of the VR industry. The strategies of major manufacturers for VR and AR devices also demonstrate intense efforts to explore new use cases beyond existing applications, or to expand into other commercial sectors such as remote assistance, virtual learning, and simulation training.

Additionally, in many countries, VR and AR are now being incorporated into medical treatments, such as psychological therapy and physical rehabilitation. Although the progress in promoting VR and AR technologies still depends on factors like pricing, specifications, and user experience, the expansion into new application markets is a positive development, particularly given the current shortage of content.

Therefore, the added-value provided by new applications will be a key determinant of the VR market’s growth momentum. Furthermore, the efficiency of using generative AI in content production holds the potential to propel device manufacturers into the next technological generation.

Join the AI grand event at Computex 2024, alongside CEOs from AMD, Intel, Qualcomm, and ARM. Discover more about this expo! https://bit.ly/44Gm0pK

(Photo credit: Apple)

Samsung Display (SDC), a subsidiary of Samsung, has been developing its own OLEDoS (OLED on Silicon) technology. However, there are reports now indicating that Samsung’s smartphone division plans to adopt Sony’s OLEDoS technology for integration into Samsung’s XR devices.

According to the Korean media “The Elec,” Samsung’s MX division has decided to utilize the technology from Sony instead of the technology from the group’s SDC, reflecting Samsung’s need for a new technology manager to oversee new semiconductor devices (referring to electronic components, such as OLEDs and transistors).

This newly created position for device development must oversee the technological advancement of all of Samsung’s electronic businesses, including Samsung MX, DS (chip division), displays, and motors. If Samsung’s subsidiaries had collaborated closely from the outset, then Samsung’s MX division might have adopted SDC’s technology instead of Sony’s. A similar situation has also occurred with the glass substrate developed by Samsung Electronics.

“The Elec” believes it is strange that SDC has not collaborated with the group’s companies on OLEDoS technology, as SDC has expertise in glass processing. This highlights a lack of clear roles and responsibilities within Samsung, which is a significant waste of internal resources.

OLEDoS and glass substrate microdisplays require close cooperation between departments such as semiconductors, displays, circuit boards, and display glass processing technology. If these departments are well integrated, it could bring opportunities for Samsung, as the company has departments capable of handling all related technologies.

However, the current situation does not reflect this. SDC initiated the M project at the end of 2022, aimed at developing OLEDoS and LED on Silicon technology. But SDC losing to Sony now means the former will lose valuable production experience.

(Photo credit: Samsung)

According to the Economic Daily News, the AI wave is ushering in a demand for updated specifications in CMOS Image Sensors (CIS), with the global CIS leader, Sony Corporation, aggressively positioning itself to take advantage of this trend. As part of the semiconductor industry’s move towards localized production, Sony has placed significant orders with TSMC’s new Kumamoto plant in Japan, boosting the production volume for the fourth quarter and rapidly increasing the new plant’s capacity utilization.

TSMC does not comment on individual customers or orders. Industry sources point out that the CIS component market previously faced an inventory adjustment issue for over a year. Recently, with clients restarting stock replenishment in anticipation of a recovery, coupled with the AI effect, various end-use applications are adopting lenses developed specifically for AI applications. This shift is expected to drive a new wave of demand for replacing old lenses with new ones to capitalize on AI lens opportunities.

Sony is optimistic about future opportunities in automotive and consumer sectors, and intends to extensively utilize TSMC’s 22nm process for producing CIS components and Image Signal Processors.

Furthermore, to seize the AI business opportunities, Sony has launched Digital Signal Processors (DSP) equipped with AI algorithms, which are expected to enhance applications such as human motion analysis, image processing enhancement, or human tracking. Especially with Sony securing large orders from clients, it is poised to become a major product line in the AI era.

TSMC’s new Kumamoto plant in Japan recently opened and is in the equipment installation phase, with production expected to start as early as the fourth quarter, focusing on 40, 28/22 nm processes for automotive and industrial clients.

The joint venture company for TSMC’s Japan plant, JASM, includes Sony as the largest shareholder besides TSMC. Sony has been a major client of TSMC for outsourced wafer production for many years. With the Kumamoto plant set to start production by the end of the year, Sony is almost certain to secure a significant share of wafer capacity, becoming a major client that fills the capacity utilization rate of TSMC’s Kumamoto plant.

(Image: TSMC)

TSMC officially gives the green light to the second fab in Kumamoto, Japan! On January 6th, TSMC, Sony Semiconductor Solutions Corporation (SSS), DENSO Corporation (DENSO), and Toyota Motor Corporation (Toyota) jointly announced further investment in TSMC’s Japanese subsidiary, Japan Advanced Semiconductor Manufacturing, Inc. (JASM).

The collaboration is expected to construct JASM’s second fab in Japan, dedicated to the 6/7-nanometer advanced process. The new facility is expected to commence operations by the end of 2027, with a total investment exceeding USD 20 billion, strongly supported by the Japanese government.

TSMC has stated that in this investment venture with JASM, TSMC, SSS, DENSO, and Toyota hold approximately 86.5%, 6.0%, 5.5%, and 2.0% of JASM shares, respectively. Toyota Motor Corporation is a new major shareholder following this capital increase, indicating its potential involvement in automotive electronics initiatives.

TSMC has further indicated that the construction of JASM’s second fab in Japan is set to commence at the end of 2024. The expansion in production capacity is expected to optimize overall cost structure and supply chain efficiency.

With two fabs in Kumamoto, TSMC anticipates in the press release that JASM’s total monthly production capacity will exceed 100,000 12-inch wafers, offering process technologies ranging from 40nm, 22/28nm, 12/16nm, to 6/7nm for automotive, industrial, consumer, and high-performance computing (HPC) applications. Capacity planning may be further adjusted based on customer demand.

For JASM’s first fab, it is planned to commence production by the end of the year. The initial facility, costing USD 8.6 billion, received subsidies of JPY 478 billion (approximately USD 3.23 billion) from the Japanese government.

The primary process of the first fab are 22/28nm and 12/16nm, with a monthly production capacity of around 50,000 12-inch wafers. Located in Kikuyo-cho, Kikuyo-gun, Kumamoto Prefecture, Kyushu, construction of the facility was announced in November 2021, ground was broken in April 2022, and construction was completed within two years.

JASM’s first fab is set to open on February 24, 2024, with mass production scheduled by the end of the year. The facility is a joint venture between Taiwan and Japan, with TSMC holding the majority of shares, Sony Semiconductor Manufacturing Corporation (SSMC) of Japan holding approximately 20%, and Toyota Group’s DENSO holding about 10%.

Read more

• [News] TSMC Reportedly Announcing Kumamoto Plant 2 in Japan, while U.S. Subsidies Expected by End of March
• [News] Multiple Fabs in Japan to Commence Production Post-2024 Boosting Industry

Sony’s gaming console, the PlayStation 5, is showing robust sales momentum. According to Reuters, a senior games executive stated that the cumulative sales of PS5 have surpassed 50 million units, and this year’s “Black Friday” sales performance has also set an all-time record.

The entertainment giant is now counting on the PS5 to continue its strong performance during the year-end shopping season, aiming to achieve the record-breaking goal of 25 million units sold by the end of this fiscal year in March.

Eric Lempel, Senior Vice President for Global Marketing, Sales, and Business Operations at Sony Interactive Entertainment stated as follows, “Given the momentum we’ve had in November and a lot of what we’re seeing in December, just in general we’re feeling very good about sales overall.”

Lempel further indicated in an interview that, “We’ve done some good promotions this year. I will say we’ve done fewer promotions at this stage of the lifecycle than we ever have in the history of the company.”

Despite recent discussions in the gaming industry focusing on the future of gaming consoles due to advancements in cloud technology, freeing games from reliance on bulky hardware, current gaming consoles continue to attract players.

In the initial release phase, the PS5 faced challenges due to disruptions in the supply chain, impacting sales. Nevertheless, this issue has since eased, and the positive reception of the game “Marvel’s Spider-Man 2,” launched on October 20th, is contributing to the increased momentum in the sales of this gaming console.

In the coming months, key games like “The Last of Us Part II Remake” and the timed exclusive “Final Fantasy VII: Remake” will be sequentially released on the PlayStation platform in January and February.

As for Sony’s competitor, Nintendo’s Switch console, despite being on the market for several years, has maintained strong sales this year, driven by the release of new games such as “The Legend of Zelda” series.

(Photo credit: Sony)