There’s No AI Without Nvidia. Meet the CEO Powering the Future

How large is your concern that these constraints will spur China to spin up aggressive AI chips?

China has issues which are aggressive.

Right. This isn’t data-center scale, however the Huawei Mate 60 smartphone that got here out final 12 months received some consideration for its homegrown 7-nanometer chip.

Really, actually good firm. They’re restricted by no matter semiconductor processing know-how they’ve, however they’ll nonetheless be capable to construct very giant methods by aggregating lots of these chips collectively.

How involved are you typically, although, that China will be capable to match the US in generative AI?

The regulation will restrict China’s potential to entry state-of-the-art know-how, which suggests the Western world, the nations not restricted by the export management, could have entry to a lot better know-how, which is shifting pretty quick. So I feel the limitation places lots of price burden on China. You can all the time, technically, mixture extra of the chipmaking methods to do the job. But it simply will increase the fee per unit on these. That’s most likely the simplest approach to consider it.

Does the truth that you’re constructing compliant chips to maintain promoting in China have an effect on your relationship with TSMC, Taiwan’s semiconductor pleasure and pleasure?

No. A regulation is particular. It’s no completely different than a velocity restrict.

You’ve mentioned fairly just a few occasions that of the 35,000 parts which are in your supercomputer, eight are from TSMC. When I hear that, I feel that have to be a tiny fraction. Are you downplaying your reliance on TSMC?

No, under no circumstances. Not in any respect.

So what level are you attempting to make with that?

I’m merely emphasizing that to be able to construct an AI supercomputer, a complete lot of different parts are concerned. In reality, in our AI supercomputers, nearly your complete semiconductor trade companions with us. We already accomplice very intently with Samsung, SK Hynix, Intel, AMD, Broadcom, Marvell, and so forth and so forth. In our AI supercomputers, after we succeed, a complete bunch of corporations succeed with us, and we’re delighted by that.

How typically do you discuss to Morris Chang or Mark Liu at TSMC?

All the time. Continuously. Yeah. Continuously.

What are your conversations like?

These days we discuss superior packaging, planning for capability for the approaching years, for superior computing capability. CoWoS [TSMC’s proprietary method for cramming chip dies and memory modules into a single package] requires new factories, new manufacturing strains, new gear. So their help is admittedly, actually fairly vital.

I not too long ago had a dialog with a generative-AI-focused CEO. I requested who Nvidia’s opponents may be down the street, and this particular person recommended Google’s TPU. Other folks point out AMD. I think about it’s not such a binary to you, however who do you see as your largest competitor? Who retains you up at night time?

Lauren, all of them do. The TPU workforce is extraordinary. The backside line is, the TPU workforce is admittedly nice, the AWS Trainium workforce and the AWS Inferentia workforce are actually extraordinary, actually wonderful. Microsoft has their inside ASIC growth that’s ongoing, referred to as Maia. Every cloud service supplier in China is constructing inside chips, after which there’s a complete bunch of startups which are constructing nice chips, in addition to current semiconductor corporations. Everybody’s constructing chips.