We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode NVIDIA's Jensen Huang on AI Chip Design, Scaling Data Centers, and his 10-Year Bets

NVIDIA's Jensen Huang on AI Chip Design, Scaling Data Centers, and his 10-Year Bets

2024/11/7
logo of podcast No Priors: Artificial Intelligence | Technology | Startups

No Priors: Artificial Intelligence | Technology | Startups
AI Deep Dive AI Chapters Transcript
People
J
Jensen Huang
领导NVIDIA从创立到成为全球加速计算领先公司的CEO和联合创始人。
Topics
Jensen Huang认为，未来十年，英伟达将通过软硬件协同设计和数据中心规模计算，将人工智能的性能每年提高两到三倍，同时降低成本和能耗。传统的缩放方法已经失效，需要新的方法，例如协同设计，即修改算法以反映系统架构，并修改系统以反映新软件的架构。此外，数据中心规模的计算和将工作推送到网络结构中也是扩展的关键。为此，英伟达收购了Mellanox，并开发了Infiniband和NVLink技术。NVLink技术将使数百个GPU能够协同工作，形成一个虚拟的超级处理器，从而实现低延迟和高输出，满足推理时间扩展的需求。稳定的基础架构对于软件生态系统和生产力至关重要，使得上层软件可以不断改进，而无需更改底层架构。

Deep Dive

Chapters
Jensen Huang discusses NVIDIA's long-term bets on computing, focusing on scaling performance and reducing costs and energy consumption.
  • NVIDIA aims to double or triple performance every year at scale.
  • The company is moving beyond Moore's Law to a 'hyper-Moral's Law' curve.
  • NVIDIA's approach involves both chip design and data center scale.

Shownotes Transcript

In this week’s episode of No Priors, Sarah and Elad sit down with Jensen Huang, CEO of NVIDIA, for the second time to reflect on the company’s extraordinary growth over the past year. Jensen discusses AI’s takeover of datacenters and NVIDIA’s rapid development of x.AI)’s supercluster. The conversation also covers Nvidia’s decade-long infrastructure bets, software longevity, and innovations like NVLink. Jensen shares his views on the future of embodied AI, digital employees, and how AI is transforming scientific discovery.

Sign up) for new podcasts every week. Email feedback to [email protected]

Follow us on Twitter: @NoPriorsPod) | @Saranormous) | @EladGil) | @Nvidia)

Show Notes: 

00:00 Introduction

1:22 NVIDIA's 10-year bets

2:28 Outpacing Moore’s Law

3:42 Data centers and NVLink

7:16 Infrastructure flexibility for large-scale training and inference 

10:40 Building and optimizing data centers 

13:30 Maintaining software and architecture compatibility 

15:00 X.AI)’s supercluster 

18:55 Challenges of super scaling data centers

20:39 AI’s role in chip design 

22:23 NVIDIA's market cap surge and company evolution 

27:03 Embodied AI

28:33 AI employees

31:25 Impact of AI on science and engineering 

35:40 Jensen’s personal use of AI tools