There’s No AI Without Nvidia. Meet the CEO Powering the Future

How huge is your concern that these constraints will spur China to spin up aggressive AI chips?

China has issues which are aggressive.

Right. This isn’t data-center scale, however the Huawei Mate 60 smartphone that got here out final yr bought some consideration for its homegrown 7-nanometer chip.

Really, actually good firm. They’re restricted by no matter semiconductor processing expertise they’ve, however they’ll nonetheless have the ability to construct very massive techniques by aggregating lots of these chips collectively.

How involved are you generally, although, that China will have the ability to match the US in generative AI?

The regulation will restrict China’s capability to entry state-of-the-art expertise, which implies the Western world, the international locations not restricted by the export management, can have entry to a lot better expertise, which is transferring pretty quick. So I feel the limitation places lots of price burden on China. You can at all times, technically, mixture extra of the chipmaking techniques to do the job. But it simply will increase the associated fee per unit on these. That’s most likely the simplest approach to consider it.

Does the truth that you’re constructing compliant chips to maintain promoting in China have an effect on your relationship with TSMC, Taiwan’s semiconductor delight and pleasure?

No. A regulation is restricted. It’s no completely different than a pace restrict.

You’ve mentioned fairly a number of instances that of the 35,000 elements which are in your supercomputer, eight are from TSMC. When I hear that, I feel that have to be a tiny fraction. Are you downplaying your reliance on TSMC?

No, under no circumstances. Not in any respect.

So what level are you attempting to make with that?

I’m merely emphasizing that with a view to construct an AI supercomputer, a complete lot of different elements are concerned. In reality, in our AI supercomputers, nearly the complete semiconductor business companions with us. We already accomplice very carefully with Samsung, SK Hynix, Intel, AMD, Broadcom, Marvell, and so forth and so forth. In our AI supercomputers, once we succeed, a complete bunch of corporations succeed with us, and we’re delighted by that.

How usually do you speak to Morris Chang or Mark Liu at TSMC?

All the time. Continuously. Yeah. Continuously.

What are your conversations like?

These days we speak about superior packaging, planning for capability for the approaching years, for superior computing capability. CoWoS [TSMC’s proprietary method for cramming chip dies and memory modules into a single package] requires new factories, new manufacturing strains, new tools. So their assist is actually, actually fairly vital.

I not too long ago had a dialog with a generative-AI-focused CEO. I requested who Nvidia’s rivals is likely to be down the highway, and this particular person urged Google’s TPU. Other individuals point out AMD. I think about it’s not such a binary to you, however who do you see as your largest competitor? Who retains you up at evening?

Lauren, all of them do. The TPU staff is extraordinary. The backside line is, the TPU staff is actually nice, the AWS Trainium staff and the AWS Inferentia staff are actually extraordinary, actually glorious. Microsoft has their inner ASIC growth that’s ongoing, referred to as Maia. Every cloud service supplier in China is constructing inner chips, after which there’s a complete bunch of startups which are constructing nice chips, in addition to current semiconductor corporations. Everybody’s constructing chips.