Amazon racing to develop AI chips cheaper, faster than Nvidia's, executives say


Systems engineering intern Prathamesh Gadad works in a lab for recently launched Amazon artificial intelligence processors that aim to tackle Nvidia and the chips made by the other hyperscalers such as Microsoft and Google in Austin, Texas, U.S., July 19, 2024. REUTERS/Sergio Flores

AUSTIN, Texas (Reuters) - Inside Amazon.com's chip lab in Austin, Texas, half a dozen engineers on a Friday afternoon put a closely guarded new server design through its paces.

The server was packed with Amazon's artificial intelligence chips that compete with those from market leader Nvidia, Amazon executive Rami Sinno said on Friday, during a visit to the lab.

Amazon is developing its own processors to limit its reliance on costly Nvidia chips - the so-called Nvidia tax - that power some of the artificial intelligence cloud business at its Amazon Web Services, the main growth driver.

Through its homegrown chips, Amazon wants to help customers compute complex calculations and process enormous amounts of data more cheaply.

Its rivals Microsoft and Alphabet are doing the same.

Sinno, the director of engineering for Amazon's Annapurna Labs that is a part of its cloud business AWS, said Amazon's customers were increasingly demanding cheaper alternatives to Nvidia.

Amazon bought Annapurna labs in 2015.

While the company's AI chip efforts are nascent, Amazon's workhorse chip Graviton that performs non-AI computing has been under development for nearly a decade and is on its fourth generation. The AI chips, Trainium and Inferentia, are newer designs.

"So the offering of up to 40%, 50% in some cases of improved price (and) performance - so it should be half as expensive as running that same model with Nvidia," David Brown, Vice President, Compute and Networking at AWS said on Tuesday.

Sales at AWS, which accounts for just under a fifth of Amazon's overall revenue, surged 17% to $25 billion in the January-March quarter, compared with a year earlier. AWS controls roughly a third of the cloud computing market, with Microsoft's Azure holding about 25%.

During its recent Prime Day, Amazon deployed a quarter million Graviton chips and 80,000 of its custom AI chips to handle the surge in activity across its platforms, the company said.

The shopping event generated a record $14.2 billion in sales, according to Adobe Analytics.

(Reporting by Max A. Cherney in Austin, Texas; Editing by Sayantani Ghosh, Matt Lewis and Nick Zieminski)

Follow us on our official WhatsApp channel for breaking news alerts and key updates!

Next In Tech News

Robots, drones could slash global food delivery costs to $1 per order, Barclays says
Leidos, Analogic to form security tech joint venture
Snap to cut 1,000 jobs after activist pressure, bets on AI efficiency
AI ruling prompts warnings from US lawyers: Your chats could be used against you
Netflix to refocus on ads, content after failed Warner Bros bid
EU age verification app ready as Europe moves to curb children's social media access
Uber commits $10 billion to robotaxis in strategy shift, FT says
Personal income tax deadline is May 15; here's how to file tax returns online with LHDN
Chip systems supplier Aixtron lifts 2026 sales outlook, shares jump
Capcom looks to extend 'golden age' with sci-fi action game 'Pragmata'

Others Also Read