Connect with us

Tech

Nvidia chases $30 billion custom chip market with new unit

Nvidia chases $30 billion custom chip market with new unit

Published

on

Nvidia chases $30 billion custom chip market with new unit

Nvidia (NVDA.O), opens new tab is building a new business unit focused on designing bespoke chips for cloud computing firms and others, including advanced artificial intelligence processors, according to nine sources familiar with the company’s plans.

The dominant global designer and supplier of AI chips aims to capture a portion of an exploding market for custom AI chips and to protect itself from the growing number of companies interested in finding alternatives to its products.

The Santa Clara, California-based company currently controls about 80% of the market for high-end AI chips, a position that has sent its market value up 40% so far this year to $1.73 trillion after it more than tripled in 2023.

Its customers, which include ChatGPT creator OpenAI, Microsoft (MSFT.O), opens new tab, Alphabet (GOOGL.O), opens new tab and Meta Platforms (META.O), opens new tab, have raced to snap up the dwindling supply of Nvidia chips to compete in the rapidly emerging generative AI sector.

Advertisement

Nvidia’s H100 and A100 chips serve as a generalized, all-purpose AI processor for many of those major customers. But the tech companies have started to develop their own internal chips for specific needs. Doing so helps reduce energy consumption, and potentially can shrink the cost and time to design.

Nvidia is now attempting to play a role in helping these companies develop custom AI chips that have flowed to rival firms such as Broadcom (AVGO.O), opens new tab and Marvell Technology (MRVL.O), opens new tab, according to the sources who declined to be identified because they were not authorized to speak publicly.

“If you’re really trying to optimize on things like power, or optimize on cost for your application, you can’t afford to go drop an H100 or A100 in there,” Greg Reichow, general partner at venture capital firm Eclipse Ventures said in an interview. “You want to have the exact right mixture of compute and just the kind of compute that you need.”

Nvidia does not disclose H100 prices, which are higher than for the prior-generation A100, but each chip can sell from $16,000 to $100,000 depending on the volume purchased and other factors. Meta has said it plans to bring its total stock to 350,000 H100s this year.

Nvidia officials have met with representatives from Amazon.com (AMZN.O), opens new tab, Meta, Microsoft, Google and OpenAI to discuss making custom chips for them, according to two sources familiar with the meetings. Beyond data center chips, the company has pursued telecom, automotive and video game customers.

Advertisement

In 2022, Nvidia said it would let third-party customers integrate some of its proprietary networking technology with their own chips. The company has said nothing about the program since, and Reuters is reporting its wider ambitions for the first time.

A Nvidia spokesperson declined to comment beyond the company’s 2022 announcement.

Dina McKinney, a former Advanced Micro Devices (AMD.O), opens new tab and Marvell executive, heads Nvidia’s custom unit and her team’s goal is to make its technology available for customers in cloud, 5G wireless, video games and automotives, according to a LinkedIn profile. Those mentions were scrubbed and her title was changed after Reuters sought comment from Nvidia.

Amazon, Google, Microsoft, Meta and OpenAI declined to comment.

$30 BILLION MARKET

Advertisement

According to estimates from research firm 650 Group’s Alan Weckel, the data center custom chip market will grow to as much as $10 billion this year, and double that in 2025.

The broader custom chip market was worth roughly $30 billion in 2023, which amounts to roughly 5% of annual global chip sales, according to Needham analyst Charles Shi.

Currently, custom silicon design for data centers is dominated by Broadcom and Marvell.

In a typical arrangement, a design partner such as Nvidia would offer intellectual property and technology, but leave the chip fabrication, packaging and additional steps to Taiwan Semiconductor Manufacturing Co. (2330.TW), opens new tab or another contract chip manufacturer.

Nvidia moving into this territory has the potential to eat into Broadcom and Marvell sales.

Advertisement

“With Broadcom’s custom silicon business touching $10 billion, and Marvell’s around $2 billion, this is a real threat,” said Dylan Patel, founder of the silicon research group SemiAnalysis. “It’s a real big negative – there’s more competition entering the fray.”

BEYOND AI

Nvidia is in talks with telecom infrastructure builder Ericsson (ERICb.ST), opens new tab for a wireless chip that includes the chip designer’s graphics processing unit (GPU) technology, according to two sources familiar with the talks.

650 Group’s Weckle expects the telecom custom chip market to remain flat at roughly $4 billion to $5 billion a year.
Ericsson declined to comment.

Nvidia also plans to target the automotive and video game markets, according to sources and public social media postings.

Advertisement

Weckel expects the custom auto market to grow consistently from its current $6 billion to $8 billion range at 20% a year, and the $7 billion to $8 billion video game custom chip market could increase with the next-generation consoles from Xbox and Sony (6857.T), opens new tab.

Nintendo’s current Switch handheld console already includes an Nvidia chip, the Tegra X1. A new version of the Switch console expected this year is likely to include a Nvidia custom design, according to one source.

Nintendo declined to comment. 

Advertisement

Tech

Microsoft to invest 2.2bn dollars in cloud and AI services in Malaysia

Microsoft to invest 2.2bn dollars in cloud and AI services in Malaysia

Published

on

By

Microsoft to invest 2.2bn dollars in cloud and AI services in Malaysia

Microsoft (MSFT.O) said on Thursday it will invest $2.2 billion over the next four years in Malaysia to expand cloud and artificial intelligence (AI) services in the company’s latest push to promote its generative AI technology in Asia.

The investment, the largest in Microsoft’s 32-year history in Malaysia, will include building cloud and AI infrastructure, creating AI-skilling opportunities for 200,000 people, and supporting the country’s developers, the company said.

“We want to make sure we have world class infrastructure right here in the country so that every organisation and start-up can benefit,” Microsoft Chief Executive Satya Nadella said during a visit to Kuala Lumpur.

Microsoft will also work with the Malaysian government to establish a national AI Centre of Excellence and enhance the nation’s cybersecurity capabilities, the company said in a statement.

Advertisement

Prime Minister Anwar Ibrahim, who met Nadella on Thursday, said the investment supported Malaysia’s efforts in developing its AI capabilities.

Microsoft is trying to expand its support for the development of AI globally. Nadella this week announced a $1.7 billion investment in neighbouring Indonesia and said Microsoft would open its first regional data centre in Thailand.

Continue Reading

Tech

Nvidia supplier SK Hynix says HBM chips almost sold out for 2025

Nvidia supplier SK Hynix says HBM chips almost sold out for 2025

Published

on

By

Nvidia supplier SK Hynix says HBM chips almost sold out for 2025

South Korea’s SK Hynix (000660.KS) said on Thursday that its high-bandwidth memory (HBM) chips used in AI chipsets were sold out for this year and almost sold out for 2025 as businesses aggressively expand artificial intelligence services.

“The HBM market is expected to continue to grow as data and (AI) model sizes increase,” Chief Executive Officer Kwak Noh-Jung told a news conference. “Annual demand growth is expected to be about 60% in the mid-to long-term.”

SK Hynix which competes with U.S. rival Micron (MU.O) and domestic behemoth Samsung Electronics (005930.KS) in HBM was until March the sole supplier of HBM chips to Nvidia, according to analysts who add that major AI chip purchasers are keen to diversify their suppliers to better maintain operating margins. Nvidia commands some 80% of the AI chip market.

Micron has also said its HBM chips were sold out for 2024 and that the majority of its 2025 supply was already allocated. It plans to provide samples for its 12-layer HBM3E chips to customers in March.

Advertisement

“As AI functions and performance are being upgraded faster than expected, customer demand for ultra-high-performance chips such as the 12-layer chips appear to be increasing faster than for 8-layer HBM3Es,” said Jeff Kim, head of research at KB Securities.

Samsung Electronics (005930.KS) which plans to produce its HBM3E 12-layer chips in the second quarter, said this week that this year’s shipments of HBM chips are expected to increase more than three-fold and it has completed supply discussions with customers. It did not elaborate further.

Last month, SK Hynix announced a $3.87 billion plan to build an advanced chip packaging plant in the U.S. state of Indiana with an HBM chip line and a 5.3 trillion won ($3.9 billion) investment in a new DRAM chip factory at home with a focus on HBMs.

Kwak said investment in HBM differed from past patterns in the memory chip industry in that capacity is being increased after making certain of demand first.

By 2028, the portion of chips made for AI, such as HBM and high-capacity DRAM modules, is expected to account for 61% of all memory volume in terms of value from about 5% in 2023, SK Hynix’s head of AI infrastructure Justin Kim said.

Last week, SK Hynix said in a post-earnings conference call that there may be a shortage of regular memory chips for smartphones, personal computers and network servers by the year’s end if demand for tech devices exceeds expectations.

Advertisement

The Nvidia (NVDA.O) supplier and the world’s second-largest memory chipmaker will begin sending samples of its latest HBM chip, called the 12-layer HBM3E, in May and begin mass producing them in the third quarter.

Continue Reading

Tech

Qualcomm jumps as AI sparks rebound in Chinese smartphone market

Qualcomm jumps as AI sparks rebound in Chinese smartphone market

Published

on

By

Qualcomm jumps as AI sparks rebound in Chinese smartphone market

Qualcomm (QCOM.O) shares rose 4% in premarket trading on Thursday after the smartphone-focused chipmaker signaled an AI-fueled rebound in demand, especially in China, after a two-year slump.

Sales to Chinese smartphone makers jumped 40% in the first half of its fiscal year, the company said on Wednesday, as buyers there gravitate toward higher-priced devices that can accommodate AI chatbots.

“Chinese vendors who traditionally relied more on MediaTek, are going to start leveraging Qualcomm’s high-end chips more as they push hard into the AI Agenda,” said IDC analyst Nabila Popal.

“They further represent an upside for Qualcomm because majority of the recovery is also going to be driven by Chinese OEMs this year, coming from a tough last two years.”

Advertisement

Qualcomm on Wednesday projected third-quarter sales that were above estimates as it also benefits from its IoT (Internet of things) and auto segments.

The company, the biggest supplier of smartphone chips, was on course to add more than $8 billion to its market value based on premarket movements. Other semiconductor firms such as Arm and Broadcom (AVGO.O) rose 2.8% and 2.4%, respectively.

According to preliminary data from research firm IDC, in the high-end segment, the AI buzz and the foldable products allowed the Android smartphone vendors to further differentiate themselves from Apple (AAPL.O) and garnered increased interest from Chinese consumers in the first quarter of 2024.

“We’re optimistic that numbers can be driven higher, given last year’s muted Android cycle and the likelihood of IoT(internet of things) improvement as inventory normalizes,” analysts at Wolfe Research said.

At least 14 analysts raised their price targets on Qualcomm, according to LSEG data.

Advertisement

Qualcomm’s shares have gained 13.5% this year following a 31.5% rise in 2023.

Shares of Apple, which is set to report earnings after market closes on Thursday, were up 1.05% in premarket trading.

Continue Reading

Trending

Copyright © GLOBAL TIMES PAKISTAN