We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode Meta's Groundbreaking AI Glasses

Meta's Groundbreaking AI Glasses

2024/11/30
logo of podcast Lex Fridman Podcast of AI

Lex Fridman Podcast of AI

AI Deep Dive AI Insights AI Chapters Transcript
People
J
Jaeden Schafer
Topics
Jaeden Schafer:Meta公司在2024年大会上发布了一系列令人瞩目的AI成果,其中包括Meta AI用户数突破5亿,以及备受期待的Orion眼镜。Orion眼镜在外观设计和电池续航方面均优于竞争对手Snapchat眼镜,其能够投射全息图,被誉为Meta的"iPhone时刻"。虽然目前尚未面向消费者发售,但其轻便的设计和透明版本的推出,预示着其在AR眼镜领域的巨大潜力。 Meta还推出了Quest S3头显,价格亲民,具有混合现实功能,但未来可能被Orion眼镜取代。Meta AI也迎来了重大更新,将增加语音功能,并与Messenger、Facebook、WhatsApp和Instagram等平台集成。语音功能将包含多个名人的声音,这与OpenAI的策略形成对比。 此外,Meta发布了Llama 3.2 AI模型,具有多模态能力,可以处理图像和图表,但由于欧盟的AI法案,在欧洲部分功能受限。Meta还与Ray-Ban合作推出了智能眼镜,其功能相对基础,但外观更贴近普通眼镜。该眼镜支持语音交互、图像识别和实时翻译等功能,并可以与亚马逊音乐、Audible和iHeartRadio等应用集成。 Meta AI的其他功能还包括图像视觉搜索、3D图像生成和翻译配音服务,其中翻译配音服务甚至可以实现唇形同步。总而言之,Meta公司在AI领域取得了显著进展,并积极开源其技术,在市场竞争中占据领先地位。

Deep Dive

Key Insights

What is the user base of Meta AI compared to OpenAI?

Meta AI has reached 500 million users, significantly surpassing OpenAI's 200 million monthly active users.

What are the key features of Meta's Orion glasses?

Meta's Orion glasses project holograms around the room, feature a small puck for intensive AI computing, and have a sleek design compared to competitors like Snapchat Spectacles. They also include a wrist strap for hand tracking and are lightweight with a transparent version available.

How do Meta's Orion glasses compare to Snapchat Spectacles?

Meta's Orion glasses are sleeker, less bulky, and have a longer battery life compared to Snapchat Spectacles, which only last 30 minutes and have a bulkier design.

What is the significance of Meta's Orion glasses in the AR market?

Meta's Orion glasses are considered the first consumer full holographic AR glasses, positioning them as a significant competitor to Apple's Vision Pro and other AR devices.

What new capabilities does Meta AI introduce with its voice feature?

Meta AI's voice feature allows users to interact with AI using celebrity voices like Dwayne Johnson, Judy Greer, and John Cena, with licensing deals in place to avoid legal issues.

What are the key updates in Meta's Llama 3.2 AI model?

Meta's Llama 3.2 AI model is multimodal, capable of interpreting charts, graphs, captioning images, and pinpointing objects in pictures. It comes in 11 billion and 90 billion parameter versions but is restricted in Europe due to the EU's AI Act.

How does Meta's Ray-Ban collaboration differ from the Orion glasses?

Meta's Ray-Ban glasses are sleeker and less bulky, primarily functioning as cameras and speakers with Wi-Fi capabilities. Unlike Orion glasses, they project messages directly in front of the user rather than creating holograms around the room.

What are the live translation capabilities of Meta's smart glasses?

Meta's smart glasses can live translate between English, French, Italian, and Spanish, allowing users to communicate in their native languages and understand each other in real-time.

What is the image visual search feature in Meta AI?

Meta AI's image visual search allows users to upload an image, such as a cake, and receive detailed instructions or recipes based on the visual content.

What is the new translated dubs feature for content creators in Meta AI?

Meta AI's translated dubs feature allows content creators to dub their videos in another language with lip-syncing, making the translation appear more natural and synchronized.

Chapters
Meta AI has reached an astounding 500 million users, outpacing competitors and setting a new benchmark in the AI landscape. The episode also introduces the groundbreaking Orion glasses and previews the exciting AI innovations unveiled at Meta's 2024 conference.
  • Meta AI surpasses 500 million users
  • Orion glasses introduction
  • Meta 2024 conference announcements

Shownotes Transcript

Translations:
中文

I've said it before, but today I want to go over some of the top things that have come out of Meta and some of the amazing new AI things they just announced at their Meta conference in their Meta 2024 conference. A bunch of crazy new things, you know, there's incredible headline things like the fact that their Meta AI has just reached 500 million.

million users, which is absolutely insane compared to opening eyes, 200 million monthly active users. So probably maybe even similar monthly active, maybe Med is even beating them on that. This is really, really phenomenal. And of course, their Orion glasses, I'm going to be diving into the specifics with

all of the new innovation that they've come out with AI. There's a ton that they have announced. I'll be diving into all of it. Before we get into that, I wanted to say if you're interested in making money with AI, in maybe starting a side hustle using AI, or growing your already existing business with AI, we have a school community called AI Hustle where I release exclusive pieces of content, the exact software, tools,

I'm selling, ways I'm monetizing AI, things I can't share publicly. I share them all in this group. So if you're interested in joining this community, it is $20 a month, or I think $19 a month. It's severely discounted. It'll be $100 in the future, but we have it at a discount rate now. So if you're interested, join the community and I would love to have you on board as we break down exactly what we're doing, help you make money with AI and grow your business.

business. Okay. So onto what open AI is doing. I think the biggest thing that they announced that everyone is really talking about the most is their Orion glasses. Now, this is really, really interesting because, um, there's obviously other competitors in this space. We have Snapchat who has Snapchat spectacles. The problem with Snapchat spectacles is they only have a 30 minute battery life. So with these new Orion glasses that meta has revealed, um,

Absolutely phenomenal because they look just like real glasses. They're slightly bulkier. But when you're comparing these two Snapchat spectacles, you can just, you know, really tell that there is a there's quite a big difference in quality.

in the look. Snapchat's new spectacles, they look much bulkier. They're very thick. They just don't look as kind of streamlined as these new meta ones. So Snapchat is bulky. Now, the other problem with the Snapchat spectacles is that they only have 30 minutes of battery life. So they're like, oh, it's a cool GoPro on your head. This is definitely not a good sign in my opinion. So Orion looks much cleaner and they got around

I think a lot of the battery issues, a lot of the computational issues by having a puck, essentially a small puck that fits in your palm. You keep this in your pocket and it does a lot of the computing for some of the more intensive AI things. Now, the reason that these are important is these aren't just...

you know, necessarily AR glasses or maybe just like glasses. These actually project, there's two lenses in here and they project holograms around the room that you are able to look at. So this is really getting to the point where it's replacing something like Apple's Vision Pro or even the Quest, although they do have updates to the Quest. They have a wrist strap that you wear, kind of looks like a watch. I wouldn't be surprised if they added like a watch face on there. So it seemed more normal that you wear it, but essentially this is going to be, yeah,

This is going to be for like the hand tracking and all the stuff that you need there. But overall, really impressive. People are calling this the iPhone moment for meta just because of, you know, how streamlined and impressive this technology is now.

They're saying that this is the first consumer full holographic AR glasses. This is what Zuckerberg's saying. The sad thing is they're not coming anytime soon for consumers. They're definitely lightweight. They've showed this off. I've seen a bunch of interviews where essentially Zuckerberg is showing off these glasses to people and they have another version of the Orion glasses that are clear. So they actually have a transparent version.

um, sides and Zuckerberg was really kind of, uh, showing the exact insides of the glasses. Um, and just how much everything is really just crammed in there. So really, really impressive everything that they have going on. Um, with these glasses, you can see that just, uh,

Inside, they have cameras right on the front of the glasses, but the whole thing has just got stuff all on the inside of it. So anyways, the glasses are really, really impressive.

And definitely an impressive engineering feat. So they have tested these out with a bunch of impressive people, including NVIDIA's CEO, Jensen Huang. And this was kind of all part of the big reveal. So hologram, meaning you wear these glasses and it can project in front of you, movies, apps, messaging, exactly like you would have expected from Apple's Oculus or Apple's Vision Quest or

Or, sorry, Apple's Vision Pro. So it does all of that and really does it in such a small form factor that I think gives it around for the money. But that doesn't mean they're completely abandoning VR. Meta's Quest S3 headset has launched. It's only $299. This is absolutely incredible in my opinion. It's got six cameras on the front. It's much cheaper.

It's a very impressive piece of technology. They're very, very enthusiastic about it. And of course, it's kind of mixed reality. So the cameras on the front mean that you can also see in front of you. Same thing as the Apple Vision Pro.

So yeah, very impressive piece of technology. I feel like it's going to get I could be wrong. I feel like it's going to get sunsetted by essentially this Orion glasses, but definitely could be wrong on that. I think Orion is going to be very, very popular. So they've also announced that the quest two and quest pro are going to be discontinued now because they have the new quest as three out. So that is all going away in favor of that.

So let's talk about some of the technology, some that is getting built into meta AI, the really popular AI agent or model. I mean, it's really Lama, but it's what is powering so much of what they're doing, whether that's Orion or what they're doing with...

just so many of their tools, even the Ray-Ban Colab. All of this is being powered by Meta AI. So one big update they've announced is that Meta AI is going to get voice. So kind of like OpenAI that you can talk with on chat GPT.

Messenger, Facebook, WhatsApp, and Instagram are all going to be getting this voice. What's interesting is you're going to get a bunch of different celebrity voices. So you're going to get Damie, Judy Drench, John Cena, Awkwafina, Kristen Bell, Keegan-Michael Key. So there's a bunch of celebrities that you can get their voices, which is interesting to me only because OpenAI launched with a bunch of different voices and they had one that sounded very similar to Scarlett Johansson. And there's kind of this like whole lawsuit. So it looks like Meta is going a very different direction where they

actually are talking to their celebrities ahead of time, getting licensing deals and paying them for it. Unlike opening eye that just sort of tried to rip off Scarlett Johansson's voice, hoping that nobody would, I don't know, would have an issue with that. So, um, all of this comes just a day after opening. I announced that they are going to be rolling out their advanced voice mode, which by the way, I'm still on the wait list for, they said they're going to be rolling it out soon, but it's still not on my phone. So hopefully I'm getting that soon. Um,

But in any case, it looks like they're really trying to stay competitive. Now, this is, of course, their voice, advanced voice mode. They've had regular voice for a while on OpenAI's chat GPT. So I think Meta is still catching up because even if they have celebrities and that's cool, they don't have the advanced voice like OpenAI where it's really, really versatile and it can be happy or sad or fast or slow or quiet or whisper and have all the very, like, versatility. So...

That's all very interesting. Now, all of this to say, Meta AI is a very used tool because it's on Messenger, Facebook, WhatsApp, and Instagram, and it has passed 500 million users across all those platforms on Meta AI. I have used it a ton. I know a bunch of people that have used it a ton. It's actually a fairly decent tool, and the distribution is just incredible on all of these social media apps, so they can really get some impressive usage metrics on all of that.

Um, the other big announcement is that Meta's Lama 3.2 AI model has been released. Um, now this is impressive because pretty much a whole bunch of these, the Lama models are now multimodal, um, which is, you know, something that we're seeing from open AI where they're, you're able to essentially interact with data and upload images and do all that kind of stuff.

Lama is getting into this now. Their new 11 billion and 90 billion parameter models can interpret charts, graphs, caption images. They can pinpoint objects and pictures if you give it simple instructions. So stuff that you're seeing out of ChatGPT, but it's impressive that they're now getting it and becoming very, very competitive with some of the bigger players, especially when you look at the fact that OpenGPT

that Lama is open sourcing and Meta is open sourcing so much of what they're putting out with Lama, unlike OpenAI, who used to be open sourced and is now closed source, is about to be a for-profit company from a nonprofit. It's so interesting because it seems like these companies have just swapped and reversed that whole dynamic there. So,

really interesting. One thing that is notable, LAMA 3.2, which is their 11 million and 90 billion parameter models, you can't actually use them in Europe. This is all due to the EU's

AI Act that has a bunch of restrictions. There's a bunch of different meta features available everywhere else, like image analysis. Those are all disabled for European users. So unfortunately, if you're in Europe, you're going to need a VPN or you won't be able to use those through Meta's products. So we talked a little bit at the beginning about Meta's

collaboration with Ray-Ban because it's similar. And I've had a lot of people ask me like, what the big difference between the Meta glasses and the new Orion glasses are. I think the main difference is, or the biggest thing you're going to notice is Meta's Ray-Ban

These things look much more like real glasses. They're much sleeker. They're a little bit less bulky. And the reason is because they just have less hardware to them. Mostly they're a camera and a speaker is most of the hardware and then a Wi-Fi transmitter. That's all they really have to fit in here.

On the lens of the glasses, they actually can project, I believe, like messages and other things like that. But it's not. It's just kind of something that will show up in front of your face. And it's unlike Orion, which is more of like holograms where you can look around and there's different things all around you and things are projected around. This is kind of just like something that's just stuck pinned right in front of you on these ones. So really, really impressive glasses, really impressive technology either way. Yeah.

They are essentially, you know, these new smart glasses. You can use it for a bunch of different things. You can talk to it through its speaker and it can display things for you or give you the response that you're looking for. It can talk back through its speaker. You can ask it about things that you're looking at. So it's got a camera right on the front. So if you're looking at your bicycle chain that fell off your bike and you're like, hey, how do I put this bike chain back on? It sees what you're talking about and it can give you help with that. So overall, really, really impressive. The other thing that I absolutely love

loved about that, um, is that it's going to be getting some reminder features and also some live language translation. So it can do English, French, Italian, or Spanish. And in between any of those languages, it can live translate. So if you're talking to someone, um,

in English and they reply back in Spanish, you can understand what they're saying. And if you both have the glasses, you can talk in your native languages and both completely understand each other. So I thought this was really impressive. They also have a bunch of integrations with apps like Amazon Music, Audible, and iHeartRadio. So you can listen to music through the glasses, which is

cool. I'd be curious to see like if anyone else around you can hear it, or something you just kind of use by yourself. Or if it really if it could actually replace headphones or not, right. So I guess it's really close to your ear, potentially, but I'd be worried you're just like wearing a boombox on your head and you'd be annoying everybody. So that would be my concern there. I'll let you know when I try them out.

Um, there's a bunch of other really interesting things that have also been revealed with Meta AI. One of them is because they can now do the image, um, they can do image visual search. So you can upload an image of a cake and say, how do I make this? And it can give you the whole recipe to the cake stuff. You could imagine ChaiGPT would do. Um, and Apple is even working on some image-based search stuff too. So in any case, this is impressive stuff coming out of Meta.

And it can also share what you get back to your Instagram story, which is interesting. The funny use case that I've been using Meta for just yesterday when I realized they do this, you can go over to the Meta app and say me as and...

say anything you want. You can say me as royalty, me as a Viking, me as a pirate, and it will generate, it's going to take three pictures of you. You have to look right, left, and straightforward. You take three pictures and it will take your face and generate you as any of those people. Now there's been a bunch of apps that have been doing this over the last year or two. A lot that have gone viral. Some of them have made millions of dollars. And it's interesting because Meta is doing this all for free now. So most all those apps are going to be killed off

What's interesting to me is that you can also make these things 3D. So you generate you and then you make it a 3D version of you where you can move around it. Really, really impressive stuff. I tried it on a ton of different... I did a ton of different...

images of myself, which was pretty funny. A bunch that were Mia's all sorts of characters, Vikings, pirates, everything else is really impressive. I was very, very impressed with the technology. You can go check it out right now. It's live, which I always love it when they make an announcement or find out about something that's currently live.

The other thing that I think is very, very interesting is they're going to be doing translated dubs for content creators. So what this means is you could create like an Instagram reel, you telling some sort of story, it's gonna be able to dub it in another language, but not just dub it with, you know, another you speak in another language, it actually is going to

dub your lips as well. So your lips are going to sync up. And to me, that is absolutely amazing. That's definitely beyond just translating the captions. Yeah, it's interesting. I'd be curious to see when that actually comes up, but it's going to do the translated dub and lip sync as well. So apparently they have some experiments right now running to some limited creators in the US and Latin America. So English and Spanish are the two languages they're focusing on. And I imagine

they'll roll this out to more in the future. But overall, very, very interesting. Zuckerberg did a demo that was kind of funny during this whole thing where he

had a creator come up, Don Allen Stevenson III. And when he was up on stage, instead of interviewing him, Zuckerberg went and just interviewed an AI clone of him that was on Meta AI. Anyways, funny, funny stuff. So tons of new stuff coming through Meta. Very, very exciting time to be in AI. I'll keep you up to date on all of that. Everything else that Meta announces because there is a ton. I think they're one of the top

top players in AI right now, and they're crushing a lot of the competition and open sourcing a lot of this stuff. So definitely getting a ton of points. Again, if you're interested in making money with AI, make sure to join the school community. It is at a discount this week, but the price will increase in the future. Would love to have you there to learn about making money through AI side hustles or growing and scaling your business with AI. Thanks so much for joining us for the podcast today, and I will catch you next time.