We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode 883: Blackwell GPUs Are Now Available at Your Desk, with Sama Bali and Logan Lawler

883: Blackwell GPUs Are Now Available at Your Desk, with Sama Bali and Logan Lawler

2025/4/29
logo of podcast Super Data Science: ML & AI Podcast with Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn
AI Deep Dive Transcript
People
L
Logan Lawler
S
Sama Bali
Topics
Sama Bali: 我在NVIDIA领导AI解决方案的市场推广工作。GTC大会盛况空前，吸引了众多开发者和数据科学家。大会上展示了大量的创新成果，甚至有人凌晨6点就开始排队等候主题演讲，这体现了AI技术发展的热潮。NVIDIA RTX Pro Blackwell GPU的一大特点是GPU内存翻倍，达到96GB，为本地运行大型模型和应用提供了强大的支持。企业客户越来越需要本地化的AI计算能力，以满足学习和实验的需求，因为云和数据中心资源日益稀缺。NVIDIA AI Enterprise是一个端到端的软件开发平台，它不仅能加速数据科学流程，还能帮助构建新一代AI应用。NVIDIA将AI软件作为微服务提供，是为了方便开发者快速替换和更新模型，适应AI技术快速发展的现状。NVIDIA Nemo可以帮助构建、训练和微调模型，并添加模型护栏以确保应用按预期使用。CUDA（计算统一设备架构）通过支持NVIDIA GPU上的高效并行计算，显著加快了AI模型的训练和推理速度。RapidSCUDEF等CUDA库能够在无需代码更改的情况下，显著加速数据预处理等任务。未来AI将更加普及，并融入日常生活，简化人们的工作和生活。AI正从生成式AI向代理式AI发展，未来将出现更多能够学习、感知和行动的AI代理，并与物理世界深度融合。 Logan Lawler: 我领导戴尔Pro Max AI解决方案团队。戴尔Pro Max电脑专为应对高强度计算工作负载而设计，将服务器级别的AI能力带到了桌面。GTC大会信息量巨大，建议与会者提前制定计划，才能更好地利用时间和资源。戴尔Pro Max GB10和GB300工作站专为数据科学家和开发者设计，预装了NVIDIA软件，开箱即用。NVIDIA AI Enterprise软件可以无缝连接戴尔Pro Max电脑和服务器，方便模型的部署和扩展。GB10工作站体积小巧，可以与Windows系统配合使用，实现工作效率的提升。戴尔Pro Max GB300工作站采用Grace Blackwell超强芯片设计，拥有强大的计算能力和内存，能够满足高强度AI工作负载的需求。戴尔Pro Max GB10工作站价格适中，适合学生或小型企业使用；GB300工作站价格较高，但性能强大，适合大型企业或需要高性能计算的用户。未来AI将更加普及，并融入日常生活，简化人们的工作和生活。

Deep Dive

Shownotes Transcript

Returning after the “Super Bowl of AI”, NVIDIA GTC, Sama Bali and Logan Lawler talk to Jon Krohn about their respective work at tech giants NVIDIA and Dell. Sama and Logan discuss the next-gen Blackwell GPUs to their collaboration with Dell in launching Pro-Max PCs specially designed to take on heavy computational workloads as well as the incredible performance of GB 10 and GB 300 workstations, and the widening accessibility of AI developer tools and models. 

Additional materials: www.superdatascience.com/883)

This episode is brought to you by ODSC, the Open Data Science Conference), by Adverity, the conversational analytics platform) and by the Dell AI Factory with NVIDIA).

Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.

In this episode you will learn:

  • (07:29) About Dell’s Pro Max PCs

  • (14:01) Why having a Blackwell GPU from Nvidia is a great option for those new to training and deploying AI models  

  • (36:47) When it makes sense for a data scientist to switch from a Unix to a Windows based system 

  • (46:33) Logan’s and Sama’s predictions for AI