We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode Is GPT-3 Dissapointing, Killer Robots (?), the AI Hall of Shame

Is GPT-3 Dissapointing, Killer Robots (?), the AI Hall of Shame

2021/6/10
logo of podcast Last Week in AI

Last Week in AI
AI Deep Dive AI Chapters Transcript
People
A
Andrey Karenkov
D
Daniel Bashir
S
Sharon Zhou
Topics
Andrey Karenkov：一篇博客文章批评GPT-3模型，认为其只是GPT-2的扩大版，缺乏概念上的突破，但忽略了其作为少样本学习器的意义。GPT-3的少样本学习能力是一种新现象，值得关注和研究。虽然GPT-3没有概念上的突破，但其在语言模型领域的改进是显著的，改变了人们对语言模型的看法。许多AI研究中存在使用验证集或测试集进行模型选择的问题，这会造成模型过拟合。在应用机器学习的领域，经常会不恰当地使用验证集或测试集进行模型选择，这会导致不切实际的结果。强化学习领域中，经常会使用测试集进行模型选择。 Sharon Zhou：同意Andrey Karenkov的观点，少样本学习是GPT-3模型的重要特性。自动驾驶飞机技术的发展是必然趋势，因为许多飞机已经具备部分自动驾驶功能。与自动驾驶汽车相比，自动驾驶飞机的安全要求更高，因为飞机失事的后果更为严重。自动驾驶卡车技术已经取得了显著进展，但在安全性和监管方面仍存在一些问题。自动驾驶卡车上的驾驶员可能在行驶过程中休息，这可能会带来安全隐患。与城市道路相比，高速公路更适合自动驾驶卡车的应用。

Deep Dive

Chapters
Discussion on a blog post criticizing GPT-3 for not offering significant advancements over GPT-2, focusing on the disappointment in its few-shot learning capabilities.

Shownotes Transcript

Our 59th Last Week in AI episode with a summary and discussion of last week's big AI news!

This week:

-

GPT-3: a disappointing paper)

-

NYU, Facebook & CIFAR Present ‘True Few-Shot Learning’ for Language Models Whose Few-Shot Ability They Say Is Overestimated)

-

Google Ventures-backed Merlin Labs is building AI that can fly planes)

-

Self-Driving Truck Completes 950-Mile Trip 10 Hours Faster Than Human Driver)

-

King County is first in the country to ban facial recognition software)

-

Have autonomous robots started killing in war?)

-

Don't End Up on This Artificial Intelligence Hall of Shame)

Find this and more in our text version of this news roundup:  https://lastweekin.ai/p/119

Music: Deliberate Thought, Inspired by Kevin MacLeod (incompetech.com)