cover of episode Sundar Pichai, CEO of Alphabet | The All-In Interview

Sundar Pichai, CEO of Alphabet | The All-In Interview

2025/5/16
logo of podcast All-In with Chamath, Jason, Sacks & Friedberg

All-In with Chamath, Jason, Sacks & Friedberg

AI Deep Dive AI Chapters Transcript
People
A
All
D
David Friedberg
美国企业家、商人和天使投资者,创立并领导了The Climate Corporation和The Production Board。
S
Sundar Pichai
Topics
David Friedberg: 我认为谷歌正处于一个关键时刻,面临着被AI颠覆的风险。传统的搜索模式正在被基于AI的聊天界面所取代,用户可以直接获得完整的答案。如果谷歌不能快速适应这种变化,可能会失去其核心的广告收入来源。我希望了解谷歌如何应对这一挑战,以及Gemini在谷歌的AI战略中扮演的角色。 Sundar Pichai: 我认为AI为搜索带来了巨大的机遇。谷歌早在十年前就将AI放在首位,并持续进行投资,例如Google Brain和DeepMind的收购。我们已经看到AI Overviews等功能显著提高了搜索质量和用户参与度。我们正在积极开发AI Mode等新体验,让用户可以通过更自然的方式与搜索互动。我不认为这是一个零和游戏,而是相信AI将扩展搜索的用例,并为用户提供前所未有的信息获取方式。我们遵循用户至上的原则,并坚信盈利会随之而来。我们有信心能够顺利完成从传统搜索到AI驱动搜索的转型。

Deep Dive

Chapters
Sundar Pichai addresses concerns about Google's vulnerability to disruption by AI, highlighting Google's proactive approach to integrating AI into its search engine and other products. He emphasizes the importance of user experience and continuous innovation.
  • Google is proactively integrating AI into its search engine.
  • AI overviews are used by over 1.5 billion users.
  • Google is developing an AI Mode for search with enhanced conversational queries.
  • Cost per query has fallen dramatically.
  • Ad revenue with AI overviews has reached the baseline of without AI overviews.

Shownotes Transcript

Translations:
中文

We're sitting here at the Googleplex with the CEO of Alphabet, Sundar. Thanks for being here. Great to have you here, David. Look forward to it. Is Google at risk of being truly disrupted from AI? Recently, we're testing it in labs. This whole new dedicated AI experience called AI Mode coming to search. OpenAI has SAM. XAI has Elon. Meta has Zuck. Microsoft has Satya. Are you willing to kind of

share your perspectives on those four competitors. I think maybe only one of them has invited me to a dance, not the others. Biggest regret? Look, there are acquisitions we debated hard, came close. Just give me one name. We'll get in trouble. Maybe Netflix. We just leaned into the user experience and over time we figured out monetization to follow. It's like one of the original principles of Google, follow the user, all else will follow. Yeah, there you go.

All right, besties. I think that was another epic discussion. People love the interviews. I could hear him talk for hours. Absolutely. We crushed your questions. Admit it. We are giving people ground truth data to underwrite your own opinion. What'd you guys think? That was fun. That was great. I'm doing

I'm really excited for this conversation. You and I started working at Google on the same day in 2004. I didn't quite realize that. We were both in the same time. Same Noogler class. We had the hats on that same week, on the Friday All Hands.

I'm now a podcaster. You've done a little bit differently. You're more than a podcaster, but you're very good at podcasting too. Well, I appreciate it. I think I respect the other stuff you've done as well. I appreciate it. But in your tenure at Google, you ran Chrome, Chrome OS Drive, Google Maps. And it's been 10 years now since you've been the CEO here at

Google now Alphabet, amazing and congratulations. Under your tenure as CEO, the stock has gone up by four and a half X to a $2 trillion market cap today. You've grown revenue from 20 billion a quarter to nearly 100 billion a quarter. It's been a really like incredible run to see someone that kind of started as a PM and grew your way into this incredible role. So congrats. How have you liked the job? - No, look, I mean, I love building products.

And in some ways, Google was really set up, I think the founders set up this kind of a deep computer science approach. And you take that and apply it to build things which can impact people on a day-to-day basis. And so it's that kind of a product and technical culture, which is the essence of the company.

So, I love doing that and there's not a single week which goes by where I feel like I don't get to do that. So, those are the parts I really enjoy. But obviously, running a company of this scale where you impact so many people, I think it's a privilege. So, I enjoyed every part of it. You're at a pivotal moment in the company's history today. Have you read The Innovator's Dilemma?

- I'm obviously very, very familiar with the concept. I don't think I've read the book actually, but it's one of those things which is so much in the ether, you think you know it. - Right, I say it in jest because that's the talk of the town, the talk on Wall Street, the talk in Silicon Valley, is Google getting disrupted in this moment?

AI seems to create a fundamentally different paradigm for human-computer interaction. Consumers are asking AI questions through chat interfaces, they're getting complete answers, they're engaging with AI systems in a way that they traditionally didn't do with the classical search interface. Is Google at risk of being truly disrupted from AI? Is the core search business, which the ad revenue on search is about a $200 billion run rate out of $360 billion of your total revenue, most of your profits,

And it seems like Google's in a really challenging quandary where if you disrupt yourself too quickly, all of that revenue can go away. It can be really impactful.

Is Google being disrupted by AI at this moment, or is Google leading? It's a good framework, good question to talk about. I've definitely, for almost a decade, one of the first things I did was to think of the company as AI first. It was very clear to us. We had Google Brain underway in 2012. We acquired DeepMind in 2014. 2015, when I became the CEO, I said, "Look, the technology is really evolving."

The reason we were excited to approach our work as AI first is because we really felt that AI is what will drive the biggest progress in search. And so, you know, I think even the last couple of years, I view this as an extraordinary opportunity for search. I think if you look at how much information means to people,

I think each person is going to have access to information in a way they've never had before. So it feels very far from a zero-sum construct to me. And we are seeing it empirically when people are using search. Obviously, there are a couple of major things we have done with search. Transformers drove some of the biggest innovations in search with BERT and MUM, dramatically improved search quality.

We launched AI overviews about a year ago. It's now being used by over 1.5 billion users in over 150 countries. It's expanding the types of queries people can type in, and we see it empirically. The nature of queries is expanded, so there are whole new use cases coming into search. We find for queries where we trigger AI overviews, we see query growth.

and the growth continues over time. Getting the feedback from AI overviews, recently we are testing it in labs. This whole new dedicated AI experience called AI Mode coming to Search. We'll speak about it more at Google I/O. And in AI Mode, you can have a full-on AI experience in Search, including follow-on conversational queries. And we're bringing our cutting-edge models there.

where the models are actually working to answer your questions using search as a real native tool, right? And there the queries, people are typing in queries like literally long paragraphs, right? The average query length is somewhere two to three times is what we see in search as it existed two years ago. So we are seeing people respond. In search is always from the outside people look at it and say, "Search kind of looks easy to do." The craft of search is very hard.

Over two decades, I think we've had a real North Star of understanding what users want in search. And you've been here. We are kind of a very metrics-driven company. We kind of know what works. Users are our North Star. And empirically, we see that people are engaging more and using the product more, right? So all that. To your question about innovators' dilemma, I think

The dilemma only exists if you treat it as a dilemma, right? Like, you know, say for me, all along in technology, you have these massive periods of innovation and you lean into it as hard as you can. It's the only way to do it. You know, when mobile came, everyone was like, well, you know, it's like you're not going to have the real estate, like how will ads work, all that stuff. You know, mobile was a transition which ended up working great. I can give great examples, right? Like TikTok has come in.

YouTubers thrived since the moment TikTok has come in, right? And it was a whole new format. We did Shorts when we launched Shorts. Shorts absolutely didn't monetize anywhere near long form, but we just leaned into the user experience. And over time, we figured out monetization to follow.

So, you know, to me, you know, you don't think about it as a dilemma, like, you know, because users, you have to innovate to stay ahead and you kind of lean in that direction. It's like one of the original principles of Google, follow the user, all else will follow. Yeah, there you go. And I think...

The Google is dead disruptor narrative has, as you point out, been kind of repeated a number of times. Today people are pointing specifically, and I appreciate your points about there's new search experiences coming. The search experience, it sounds like, is going to evolve.

As people look at standalone apps, they compare Gemini as a standalone app to ChatGPT, to the Meta experience. The stats that came out in the recent court testimony that had some data revealed from March, I don't know where the data came from, but it said the Gemini AI app had 350 million monthly users compared to ChatGPT at 600 and Meta AI at 500.

Is that the wrong way to think about it, that the Gemini standalone app isn't the future or the AI bet that Google's making, but it sounds like there's going to be much more of a kind of timed out integration into how the search experience evolves? And what happens to Gemini? In search, maybe the most widely used in AI product today might be search with AI overviews. People are using it intensely.

Obviously, we have a standalone Gemini app. I think we are making progress there, particularly with the introduction of Gemini 2.5 Pro. We've seen a real uptick in engagement and usage growth in the product. We have a lot more to come just in the last

In a few weeks, we have shipped deep research and updated Canvas, audio overviews. You can now go and generate, do video generation with VO2 straight in the Gemini app on Android phones with Gemini Live. You can screen share. It can talk to what's on your screen. So there's a lot coming that way, and users are responding.

Look, ChatGPT has obviously had phenomenal success, but I think it's still early days and we are definitely seeing traction, seeing growth. To me, what matters is if you innovate, our users responding and using it more, and that seems to be the case. So it's in our hands to continue innovating. I think it's a fiercely competitive moment. But I would say across our products, people are coming and using.

consuming information across search, using the Gemini model increasingly in YouTube, in the Gemini app and so on. So I think it's a much broader view we have. - If I were to think about the unit economics of Google's business, there's a cost to serve a search query

and there's revenue per search query, ad revenue per search query. How is that number changing or how will that change in this kind of evolution and search towards more of an AI interface? Because I've got to assume that to serve an AI-driven query is much more expensive than to serve a search query. Look, this is something I think people are really worried about two years ago, but always felt

to the extent that something is about the cost of serving it. Google with its infrastructure, I'd wager on that, right? And, you know, on our chances to do that better than pretty much anyone else. And, you know, we've actually seen like, you know, for a given query, the cost to serve that query has fallen dramatically in an 18-month timeframe. What is probably more of a constraint is latency, I would say. So it's less the cost per query.

I think our ability to serve the experience at the right latency, you know, search has been near instant. So how do you think about that frontier has been more of a question. The cost per query is not what I think will end up

I think we'll be able to, we've done the transition well. That's not a primary driver of how it'll impact things, yeah. - And do you have a point of view on ad revenue per AI query? - We already with AI overviews, we are at the baseline of, it's the same as without AI overviews. And so we've reached that stage. But from there we can improve, right? And I think, I've always felt

You know, the reason ads have worked well in search is because commercial information is also information. People, when they have that intent, are looking for that most relevant information.

So, I don't see any reason why AI, just from a first principle standpoint, why won't AI do a better job there as well? And so, I think we are comfortable that we can work the transition through. Some of it may take time, but all indicators are that we'll be able to do it well. Over time. Over time. But it's already AI overviews. When we show ads, we've kind of reached the baseline. Do you feel that pressure on Wall Street?

and the board and like, what's the tension that you feel as a leader in trying to manage this transition

on the product, on the revenue model for an organization of this scale. I don't know how many leaders have done it successfully in the history of business. Where do you feel the tension? Where do you feel the pressure? And how much leeway are you being given by the founders and the board to do what's needed here? - Two things. I mean, the main, it's a moment of acceleration, right? So if anything, the good thing about these moments is you don't even have time, a lot of times to think about some of those questions.

I think a lot about making sure we have the best models. We are pushing the frontier as a company, and I think the last few months have shown the breadth and range of what we are doing. We are there, and we have to continue to stay there.

So for me, you think and you worry a lot more about execution from within. That's all. Are we executing? Are we moving fast? Are we innovating? And I think over the past 12 months, I think we've really picked up pace as a company to meet the moment. So that's where I do spend a lot of time. Look, as a CEO, one of the first things I did in 2015, in addition to being AI first, was to really bet big on

You know, we had great products like YouTube. We had Workspace and Cloud, but really turning them into robust businesses, right? As well as great products. Last year, we exited a combination of YouTube and Cloud at $110 billion. I think, you know,

People don't internalize that Google is one of the largest enterprise software companies in the world now. And the largest media company. In some ways, right? And definitely, we are doing a podcast. I think we have the largest podcasting service in the world. And so I feel like as a company, we are set up well. For the first time, you have this cross-cutting technology.

you know, to our earlier point, thinking of us as a deep computer science company, what better technology than AI, which horizontally can impact all aspects of our business? Search, YouTube, cloud, Waymo, and the other new things we are doing. So it feels like an exciting time. So not a lot of what, you know, we've continued to do well in search. We are doing well in these other businesses. And so to me, it feels like

one of the biggest opportunities ahead as a company too. I think the next decade ahead looks to me as exciting as the past decade, so. - As I think about my time at Google, right below us in the garage,

Urs and his team were building these super secret shipping container data centers. They had these data center in a box that you could ship anywhere as long as you had access to water and power to connect to the internet, and you could scale data center capacity all over the world. That was 20 years ago.

It's always seemed to me that one of Google's core and not well understood advantages was its infrastructure advantage, something that Google's invested into its core from the beginning. Can you tell me a little bit about where you view Google's infrastructure advantage playing out in the AI competitive landscape today? How does it translate into

cost, speed, product, quality, and where do you guys think about investing the 70 billion of capex this year in the chip layer, in the networking, the data center? - We can unpack both, right? Like where our capex is going, but on your first part, right? Like one of the ways, you know, we look at the Pareto frontier of performance and cost. Google literally is on the Pareto frontier. So we deliver the best models

at the most cost-effective price point, right? Like, you know, and our flash series of models are a real workhorse in the industry, right? And part of why we are able to do that is because, you know, we train and serve our models on our infrastructure, including TPUs, right? And we are in our seventh generation of TPUs, and we built our first version in 2017.

I remember talking about it at Google I/O. Probably people didn't pay attention to it because like, you know, why are you building a specific machine learning X-rated chip? Look, it plays out everywhere. To your earlier question on cost per query in search, the reason we feel comfortable we can serve it at that scale is because we are constantly innovating through e-generation, including chips which are really, really good at inference, right? And Ironwood, which is our latest in our TPU series,

A single pot of ironwood is over 40 exaflops, right? And so the scale of these things are incredible. And we have thought about all the way from subsea cables to the scale at which we do infrastructure is unparalleled. And I've always viewed that full stack approach, you know, deep infrastructure, foundation, fundamental R&D on top of it.

And then you build and innovate on top of that. And I think that approach will serve us well over time. But it really, you know, empirically plays out in, you know, the cost at which we are able to provide our models. Part of the reason we've had a lot of traction with Gemini 2.5 series is not only are they great models, but we are offering it at a very attractive value. And we can do that because, you know, we are driving our infrastructure costs down.

On the $75 billion in capex for 2025, you know, obviously majority of that goes into servers, data centers, and so on, servers being the vast portion of it. I would say on looking at 2025 and looking at the compute part of the span, half of that is going towards our cloud business in 2025.

Obviously, it's a very different business to search and so on.

A lot of it is to power the innovations from Google DeepMind, pushing the frontier. And we're doing it across many dimensions, right? Not just large language models, but even there, doing it across not just text, images, video, et cetera, building world models, right? So there's just a lot of innovation which we are pushing on the frontier, obviously to support our core products like Search, YouTube, Gemini, et cetera.

but 50% of the compute goes to its Google Cloud. Let's just talk about chips for a second. This is a big part of the conversation is NVIDIA has got the real market monopoly in AI is what everyone says. Do TPUs provide a wholesale replacement for your need for NVIDIA

in the supply chain or is NVIDIA still a core part of the mix in the data center for training versus inference in LLMs versus other models? Maybe just share your understanding of where the mix evolves to for you guys. Look, first of all, at a high level, NVIDIA is a phenomenal company. Jensen is awesome. We have been working with NVIDIA now for a very, very long time and we continue to do so.

we serve a lot of the Gemini traffic on GPUs as well, right? And so we give customers choice, et cetera. Internally, we train our Gemini models on TPUs, right? And we serve it that way across our products, but we use both. And I do think, look, I do think everyone in the industry is going to try and do something like that, but, you know, it's, you know, NVIDIA's R&D and their ability to drive that innovation

Their software stack is world-class, so they have a lot of advantages as a company and I have extraordinary respect for them. But we've always had, we are committed, we are actually deploying GPUs internally as well. I think I like that flexibility, but we are also long-term committed to the TPU direction as well. So I think it's a good combination to have both.

And I think we push each other and drive the frontier forward. Just going back, so there's an infrastructure advantage inherent in all of the investment that's been made for 20 plus years and the continued investment. A lot of folks have said that some of the performance in foundational LLMs is kind of starting to plateau. And as a result, we're seeing a less kind of differentiated landscape amongst the competitors. And that's

should be a consideration for Google. That's the outside kind of narrative. Can you share a little bit about, and then I want to come back to non-LLM models where there's other advantages for Google in a minute, but maybe just on this point, how much more

of an opportunity to continue to evolve LLMs is there, where's Google's advantage lie in maintaining better performance in the models over time? - I think maybe it was Andrej Karpathy who used the term AJI, which is like he called it artificial JAG,

Jagged intelligence, right? So I think the progress is not going to be always smooth, right? Like you go through these periods It looks like something slow and then you see a paradigm breakthrough etc And it's been going like that for a while I think obviously over the last couple of years in all of us scaled up on pre-training and then there was a lot of momentum at post-training and then with inference compute and and and now

There's progress with how do you take all that and stitch together in agentic workflows and so on. I do think there's a lot of progress and it feels pretty continuous to me. I think it's both true progress gets harder, which I think will distinguish the elite teams, at least on the foundational side. I think that might be a factor.

I felt the heart of the problem is, I think we are well set up for that. I think we are well set up for that. I do think we are pushing the research frontier in a much broader way than most other people, beyond just LLMs, transformer-based models, diffusion-based models, all those areas we are exploring in a deep, deep way.

And, you know, there's always the chance that we may reach a point where, you know, you quite don't get that returns to the additional compute you're going to put in. But I quite haven't seen it yet, right? The progress looks maybe harder because you're now dealing with a lot more compute. So you're really running into the loss of like, can I actually get as many electricians as I can to build the data centers at the speed, like, you know, all that stuff.

But I haven't seen, or at least talking to our researchers, haven't seen anything fundamentally, hey, like we are not going to be able to move past at this point or something like that. Does Google have a data advantage with YouTube or other products or services? Are you able to train on that data in a way that others can't? I think we have the opportunity to create much better experiences for people. I think people use products like Gmail, Calendar, Docs, YouTube, Search, etc.,

So with their permission, taking that personal context into account, I think we can deliver much better experiences. We are working on that, but it's something on which we have to deliver. But I view that as one of the differentiated innovation opportunities we have.

ahead as a company, but it's something we are thoughtfully working on. We'll make progress there. That makes a lot of sense. If search evolves, and I've been using a lot of voice AI tools, I find them incredible. I can have a conversation, access the news, dive deep on a topic. It's just so incredible. What do you view the future of human-computer interaction being five to 10 years from now as AI evolves

as computing evolves, am I looking at a screen? Am I typing in a chat? Am I using an AirPod and just getting audio? Am I doing audio plus a screen? Is it just a personalized interface and there's no even concept of the web? What does the future look like for accessing information

and pursuing my interests in life as a human using compute? That's a great question. I do think the answer has got to be, humans have adapted to computing and it's always been that way. But over time, the answer will be that you need to do less of the hard work, less of the adaptation, and computing kind of works for you. And that's the holy grail, I think. And

And we are making progress, right? Be it touch, be it voice, everything inches us towards this future. For example, when I wear AR glasses, I already wear glasses, it's not that, you know, but the AR glasses aren't quite as comfortable as my normal glasses, but they're getting there. It's obvious to me that that'll push it to the next level of seamlessness where it kind of is ambiently there and doing stuff for you.

So, I think that's the air of how it has to be more seamless and just be there for you. Will it be like neural link down the line, right? When I want to understand something, is it that seamless? I think all of that is a possibility. But I think in the immediate world, given you're going to have really natively multimodal models, which can take

audio, vision, language, all of that, and be there in your line of view. So I think when AR really works, I think that'll wow people. I'm not talking about immersive displays, I'm talking more about AR glasses, right? And I think that paradigm looks very interesting to me having used it. You can kind of feel that next leap, right? Where I think we'll all enjoy using it in a way.

But you still have a little bit of system integration challenges to work through. So we have maybe a couple cycles away to get to that sweet spot, what smartphones were in around 2006, 2007. But maybe that's the next leap, right? And so probably that's what's exciting for me. Are you spending a lot of time on hardware? Yes, right, I think. We are definitely excited about B2AR classes, the next form factors, you know,

robotics is another area, all that. And we obviously build Pixel phones, people, vast data centers. So we are definitely in the physical world. You can think of Waymo as a big robot we are driving around everywhere. So we're making with our partners cars that way. So definitely, yes. I just want to zoom out and look at, there's this competitive landscape that's emerged for Google that maybe it's always been challenging. Maybe there's always been competitors, but

They're getting a lot of money and they're investing a lot of money more than ever to compete with Google. How have the founders of Google, I've seen both of them recently, sounds like Sergey's

spending time here. They both independently shared with me that this is the most exciting thing they've ever seen in computer science, and it's transforming everything. How engaged are they? How much time do you spend with them? And what's your relationship like there? They are, you know, obviously fortunate to have both of them involved in their own unique ways, deeply. I talk to them all the time. Look, I think both Larry and Sergey, you know,

Credit to them. They always envision where AI would be. I think their ability to understand trends and I swear I've had conversations maybe as early as 15, 20 years ago about moments like this with them. I think they both would argue that this is the most exciting time in the field. They both engage in their own ways.

I think Sergey is definitely spending time with the Gemini team in a pretty hardcore way, like sitting and coding and spending time with the engineers. And that gives the energy to the team, which I think it's unparalleled, right? Like to have a founder sitting there looking at loss curves, giving feedback on model architectures, how can we improve post-training, et cetera. I think it's a rare, rare place to be.

But, you know, my favorite conversations are sometimes when the three of us sit and talk. The combination of, I mean, they're very nonlinear thinkers. So I feel like it expands the conversation into ways which you always don't expect. And out of it, which comes interesting ideas. So I think I always have access to that.

But I think I've worked with them for such a long time. There is friendship, respect, mutual dialogue. We love doing that. And I think I'll always have that. Your competitors out there have active founders. OpenAI has Sam, XAI has Elon, Meta has Zuck.

and Microsoft has Satya. Are you willing to kind of share your perspectives on those four competitors, both the companies and the leaders? - Look, it's obviously by definition, it's a very impressive group, right? And I think you're talking about some of the best companies, some of the best entrepreneurs, all that. Look, it shows how both how much progress we are going to see

because you're basically talking about many people who are working hard to drive that progress. So to the earlier question when you were talking about, are we going to see progress? The answer has got to be yes, because of the unique types of people here pushing progress. So

Look, each of them, they're different people. I'm fortunate to know all of them. And I think maybe only one of them has invited me to a dance, not the others. Right? But I just look, I spent time with Elon maybe two weeks ago when I talked to him and his ability to will future technologies into existence. I think it's just unparalleled. So like, look, these are phenomenal people. I respect all of them. You know, there's partnerships involved, there's competition involved, but

If I were to step back and say, at the end of the day, I love driving technology progress in a way that impacts people positively. When you think about areas like healthcare and other important areas, education, we are now talking about this is why AI is so profound.

So the opportunity is what excites me. I think all of us are going to do well in this scenario. That's how I think about it. Right. I think that's what a lot of people don't rock. And I think this is an important point. Everyone out there says there's competitors, there's a winner, and everyone else is a loser.

But this is an entirely new world that's going to be a lot bigger than the world we had last year. And everyone's building down their own path, but there's going to be a lot of success. It's not just that who's going to beat whom in the marketplace. When the internet happened, Google wasn't even around. So the other thing you can say is there are companies we don't even know, haven't been started yet, their names aren't known,

might be extraordinarily big winners in the AI thing, right? So it's going to be

AI is a much bigger landscape, opportunity landscape than all the previous technologies we have known. Combined. Combined. And so, you know, so which is why I think it's all about, you know, the companies which will end up doing well or you will do well because you're able to innovate and execute with the best talent. That ends up being the driver. Well, let's talk about that. And let's talk about the unknown competitor, DeepSeek popped up.

Tell me about your impressions of the model, the performance, the rumors about the next model. And what does that tell you about what's going on in China and what's going on that we're not seeing? Look, I think the main moment from DeepSeek was, look, always, if you kind of follow the AI research and scan through papers and read them, nobody who does that would underestimate China, right? So when you look at the amount of research output from China, right?

They have extraordinary talent. But I do think all of us had to adjust our priors a little bit after the deep-seek moment, which was like, well, they are even closer to the frontier than most people maybe assume. And so I think that was a moment. I think internally for us, I think externally people are very impressed and rightfully so with how efficient their models were.

Interestingly for us internally, we benchmarked it to Flash and Flash was as efficient or you could argue in some ways better. So I think to our earlier conversations, I do think this is more maybe internal baseball for us. We were benchmarking and saying, "Look, it's good to see," because they had to work in a hardware constrained way, I think, which is what drove a lot of their innovations and efficiency improvements. And so I was pleased with that.

But it tells you that the frontier is evolving rapidly. There are more players closer to it than people fully realize, and it's gonna be a very dynamic moment in the industry. I think China will be very, very competent on the AI frontier is just what I always assumed. - And much of the narrative, and I think probably the fact around the ability to deploy AI at scale

is one that is predicated on availability of electricity. Even Elon, and I've been talking about this for a while on my podcast, but Elon this week is saying, hey, I need a terawatt of compute. Terawatt is roughly the power production or the electricity production capacity of the entire United States. US is going from one to two between now and 2040. China's going from three to eight. And there's probably upside given all the new electricity production technologies that they're rolling out now, which will be additive to that.

How much is electricity generation going to play a role in who is going to economically benefit from AI over the next 10 to 15 years? And where is the US compared to China? And maybe where is Google? Well, look, you're definitely hitting on what is-- when you look at any system, you want to find where the constraint is because that's what gets the whole system.

and you are rightfully identifying the most likely constraint for AI progress and hence by definition GDP growth and all that stuff, right? So I do worry about it a lot, but the answers are

Sometimes you run into challenges which you have to solve. You're running into physics barriers or something like that. This is not a problem like that. We already know the technologies that can work to supply the demand we need. So it's more to me an execution challenge. I would phrase the energy problem as

It's obviously multifaceted, but I think be it really embracing

We shouldn't have innovators dilemma in the energy sector, right? So we should lean into all the possible innovations ahead. And there are many of them. Obviously, first of all, people perpetually, I think, will underestimate solar, right? You know, solar plus batteries will end up being huge. You know, obviously, the amount of innovation that's going into nuclear, geothermal, all

All of that are opportunities to embrace and more, I'm not mentioning. But I think upgrading the grid, solving for transmission, permitting to make all of that progress faster. And then actually, I think we may be workforce constrained, like to my earlier point. I think we are all, if you look at the number of electricians leaving the workforce,

versus suddenly all of us and you project out this demand, there's a huge mismatch, right? So literally how do you make sure there is incentives and workforce development to address shortages like that?

over the next decade will end up being important policies. I think we are fortunate, you know, people like Secretary Wright and Secretary Burgum, I mean, they are very, I think, deeply aware of the issue, and I think they are hitting the problem hard.

But I definitely think it's solvable, but I think we all have to put our mind towards it. But for your business today, you don't see electricity constraining growth in the business in this moment or in the projectable future? No, I wouldn't say that. Just for example, we are supply constrained this year in our cloud business. And when we are, all of us are simultaneously looking to scale up data centers.

And we are running into real constraints. The way the constraints play out today is delays in projects because of permitting or not having access to electricians. All of that is realities all of us are dealing with. So if this trend line continues, the pace at which we are all ramping up, and obviously for it to continue, we all have to generate the returns on it. And so it has to really impact the economy in a more substantive way so they go hand in hand.

If the trend continues, these constraints will be much more visible, I think. Today, we are all working through these constraints. So I think there are real constraints today, but I expect it to, for us to be competitive with China, et cetera, I think we have to solve these constraints in the near future. - What does that look like then, fast forward 15 years, the US has 25% of the electricity of China. Is China just bigger GDP in that moment?

Is the pie going to grow for everyone? How do we kind of think about-- The way I've assumed is the US is always-- there's never been a time where the US just doesn't meet these moments. So to me, I look at it and say, it just means that the capitalist solutions will innovate through this moment. That's why people are working hard to build SMRs and nuclear fusion, et cetera. So I've kind of assumed we will meet that moment.

And if we don't, or if the lines don't match, I think the conversations will get louder and louder till we meet the moment. That's the way I internalize it. There's a history of Google investing in innovative technologies and being ignored or being told that they don't make much sense. Good luck.

The TPU is a great example. The acquisition of DeepMind is a great example. The investment in infrastructure is a great example. The insane continued investment forever in Waymo is a great example. And suddenly it looks like Waymo is on track to be a $100 billion business, and this is actually going to work.

mind-blowing persistence and patience. By the way, we are doing the same patient approach in many other areas. That's my next question. Quantum is one. So tell me about quantum. Because everyone ignores quantum. You've had this investment for some time. Why is quantum so important?

Because again, I want to use the historical data that it seems like a small bet, good luck. But what does quantum evolve to from a compute perspective for humanity? And when does that happen, do you think? Obviously, quantum has gotten a lot more attention in the last 12 months or so. But we have been working, just like Waymo, we work through these things, whether there's attention from the outside or not, because we are working on these things out of conviction on the long-term trends, right? So it comes from those first principles.

Obviously, the universe is fundamentally quantum. To do any kind of large-scale simulations in a way that truly represent nature, you would need some versions of quantum computing. I think to me quantum feels like where AI was around 2015. So I would say in a five-year timeframe, you would have that moment where a really useful practical computation

you know, is done in a quantum way far superior to classical computers. And that'll be that aha moment, you know, I think which will really show the promise of the industry. I'm absolutely confident that we will get there when I see the progress and I can pattern match to progress in the other fundamental areas we have worked on. So it really doesn't feel like obviously, look, these are very challenging areas. You may hit a constraint.

I do think a lot of people are making announcements in quantum, so in some ways it's tough to distinguish them. We had the same scenario in self-driving maybe three years ago. There were so many people doing self-driving.

It looked like everyone was roughly the same, but they weren't. I could internally tell the difference that how far ahead Waymo was. I feel that way about our quantum effort too. I think there are a lot of announcements, a lot of noise in the industry. There are a few good people, but I do think we are at the frontier there.

And so, you know, I'm pretty excited about it in a three to five year timeframe, but we'll be patient and get there. Yeah. Do you want to speculate on a business in quantum? Look, we are committed to, you know, in almost all these cases, our goal would be to, you know, demonstrate more and more useful practical algorithms and show progress on that and give access to it through cloud, right? And...

I think I always say it's tough to project innovation on top of a platform. Nobody could say just because you had smartphones and GPS and payments, something like Uber would get invented. You couldn't linearly sit and project Uber from the underlying innovation. That's how the world works.

For me, quantum is that foundational, again, just like AI, there's going to be extraordinary innovations on top of it. We don't know the algorithms yet. It's almost like trying to predict how people would use personal computers in 1977 or something. That's right. We're very early. And some of the constraints in quantum

are that there aren't quantum computers to test them out, new algorithms to test them out. There's a lot of theory in quantum algorithm development, but not a lot of testability experimentation at this point. We are working on all of that too. I think we'll have more exciting moments to share this year. So look forward to making it happen. I think that's what's interesting. It will expand people's minds of the potential of what you can actually do. Right now, no one really knows how to think about quantum, where it's going to take us. But those announcements, I think, are going to be really prescient.

And then I'm assuming all your friends will show up and say, "We've got a quantum effort now too." Tell me about robotics. I think this was going to be the year of the robot. We see so many models being trained on simulation data or real world kind of observational data that are then being used to control physical systems, call it physical AI, call it robotics. Lots of startups, lots of big companies. Google bought Boston Dynamics and a bunch of other robotic companies. I think Andy Rubin was overseeing these for a while.

and then you sold them off and decided it was too early. What's your point of view on the opportunity in robotics today? How does Google play here? We are definitely, for robotics, you know, we again have probably, you know, one of the most advanced frontier R&D teams in the world now. You know, and the Gemini robotics efforts around vision language action models, etc., are world-class.

I do think robotics, so we are now thinking through how we either partner or where we actually bring products out. You are right, we tried the application layer too early, where I think robotics wasn't really being influenced by AI as much.

But now it's really the combination of AI plus robotics that gives that next sweet spot, right? And so we are making plans there. Nothing to share today, but you will see us make more announcements in the space. But we are definitely foundationally driving the underlying models and we are building state-of-the-art models there. We are working with partners and testing it. You know, when I look at the progress of

humanoid robots, et cetera. I mean, they are... In the past, I would say, "Oh, this is obviously... You can see how janky they are." Now, I have to take five seconds to look at it and say closely and say, "Is this fake or is this an actual robot doing it?" Right. Right. Like already I'm in that moment. And so...

And so you can see the progress in the field underway. So I think we are probably two to three years away from that magical moment in robotics too. And so that's the next exciting phase. Is a good way to think about it that Google could potentially develop the Android for robotics and ultimately have a broad play here? Yeah, we have intrinsic. So one of our bets is effectively doing that. So supporting robotics manufacturers.

We are committed to having the Gemini as a model. We'll take all modalities into account, work very, very well for robotics. It's definitely something we are committed to being on.

how we actually bring products out, first party versus third party, et cetera, is where we are thinking. I want to talk a little bit about culture, which seems to be a key differentiator on the kind of competitive landscape. I go back to thinking about Google offering free food, massages at work, 20% time as a way to attract and win in the early days of the talent wars in Silicon Valley, early 2000s, and that persisted. But what happened is it grew and it became more amenities. And the narrative is

that Google ended up creating a culture that kind of moved away from more accountability and performance and was much more about coddling employees. Can you just comment on kind of your observations on the evolution of Google over the 20 years that you've been here and what you've tried to do lately as a leader, how you think about the culture you want to foster and what you're doing about it? Look, I think it's important to step back and say, you know,

the underpinnings of a culture in which you really invest in employees and you empower them. And even some of the perks was to create a culture where it's positive, optimistic, you're in an innovation mindset, people are talking to each other, maybe by giving lunch here, people are all sitting and talking ideas through lunch, you're cross-pollinating, imagine. So that is the thesis of it, not that we are trying to give lunch to people, right?

And so I, till today, feel we still get a lot of innovation in the company at all levels of the company. And I think people wake up and say, "Well, I can go do this notebook LM," et cetera, are great examples, right? And so people do that all the time. So I think empowering employees

has been and is and will be a source of strength for Google. I think we can attract higher caliber people who feel like they have agency to do that. But that doesn't mean, I think people shouldn't confuse that with, like today for example, you can take something like Google DeepMind

I think there is all the way from Demis and others, extraordinary leadership team, be it Cori, Jeff, Oriole, Noam, et cetera. All these leaders have strong opinions on how to drive that frontier forward and that's happening too. So I think it's important to strike a balance between the two. I think when you empower employees a lot, in some ways, like we have allowed for more free speech than other companies. That's one way you can think about it. So you're gonna hear voices.

Sometimes, you can hear what is effectively 500 people in the company, but that doesn't represent the company as a whole. So, in some ways, we are different from other companies and can confuse it on the outside, I think. But I think overall, look, we have a clear sense of where we are going. I think we want to empower people all in the service of our mission. So, if anything, over the past few years—and you are right, there are moments, not just

But as an industry, I think some of the other things became more of the focus than the mission of the company and why we are all here. We are not all here in the company to resolve our personal differences or something. We are here because you're excited about innovating in the service of the mission of the company and the impact you can have. And so bringing that focus back, that's something I've been very deliberate about for the past few years.

And I think it needs reinforcing. I think one of the lessons for me was we all grew so much that you assumed everyone always understood those underpinnings. But then when you added so many people, you realize you have to go back and repeat that a lot to help people internalize that. We've done that and we do that all the time. I think moments like this help a lot too. The current moment is just genuinely...

both so exciting and so intense. It actually reminds me a lot of early Google. When I walk into the GDM building, some of our earliest engineers are all sitting there working together. People come in five days a week at a minimum. And so you have that intensity and you have that excitement

and I feel that same sense of optimism. So that's what I'm focused on. To me, that's the hardcore-ness which matters. Like are people, smart people, really working with a passion? And that's where that intensity comes from. And you have to work hard to create that. And there are pockets of the company if that doesn't happen, you figure out what are the changes you need to make to do that. And sometimes, for example, I recreated the notion of labs.

Right. And because I said, well, there are things that are possible with 10 person teams. And so we need to go and do that again. And there are quite a few projects, both we have shipping and are underway to come, which will be an outcome of those efforts as well. So, you know, your culture, your values are enduring. Culture is something you're constantly tweaking to make sure you're true to your values. And so by definition, there's going to be drift and, you know, you work hard to

snap it back. Was there a moment in the last 10 years where you said, "I've got to spend more time on this"? Oh, for sure. Look, I think COVID was such a big distortion to our way of working. Fundamentally, Google was designed to be a culture in which people were seeing each other, engaging with each other.

So losing that continuity, right, I think definitely impacted our culture. So when we have gotten people back in a 3-2 model, and some teams work beyond that, I think it's been important. I've spent time to get those connections back. Like, for example, at GDM, we were intentional in creating a physical space where we can get all of them back in the same building, both in London, both in Mountain View.

and taking our newest building with that kind of a tent-like roof structure and putting all the people in and being intentional about it.

has made a massive difference. Have you found a shift in your ability to recruit top talent? A lot of great talent has started other great companies. Other great companies in Silicon Valley have recruited folks. I know there's always a talent war going on, but has there been a tenor shift for Google in the last period of time because of some of the underlying advantages in AI or some of the cultural changes that are underway? The talent market, you know,

we go through these fierce moments for talent. AI is one of them. And whenever there are these Google, you know, obviously we are fortunate to have some of the most talented employees. So we are a source. I'm equally proud of the fact that I think Googlers have left to start over 2000 companies, right? And so, you know, there is a virtuous cycle. I think people come back, we acquire companies. I think all of that keeps the company fresh. But in the current AI moment,

Look, I think we are both holding on to critical talent. We are recruiting. You know, I always look at the tip of the tree of, are we able to attract the best PhD researchers coming out of the top programs? And the answer is yes.

And there are people who have left, who have come back. And so I feel good about the position we are, but you work at it hard every week, every month, and so on. Do you think this is going to change in the future with how we do education and how AI plays a role in education? Are you going to be able to identify, recruit, and then teach and train talent out of high schools and at an earlier age? And the traditional kind of college education system is going to change because of

AI, on-the-job training. There's a lot of potential to change. There's a part of me which feels maybe we've all misunderstood what colleges are about and maybe colleges are about the community and people getting together and exchanging. There may be intangibles which still maybe make it more valuable than we all perceive it to be.

But the way I think about it is you're going to get extraordinary talent at more places around the world. So that's the way I think about it, because people have access to with AI. So you don't need to be in a few certain places to be that great talent. So I think the nature of that changes. By the way, I think it's an important thing to internalize. We often talk about talent. We've always been able to recruit the best talent in the country.

But now there's extraordinary talent emerging in other parts of the world too. So I think it's something not to lose line of sight and maybe that's the way I would think about it. So just taking a step back, zooming back, I had a conversation 10 years ago with Larry Page where he talked about the transition from Google to Alphabet. Alphabet is going to be this holding company. It's going to discover or develop the next $100 billion revenue business. At the time, I think Google wasn't quite at $100 billion. There have been a lot of these investments and other bets.

since that time. Do you still think about Alphabet as a holding company? Are there still multiple businesses that you want to kind of stand up and foster and have this kind of holding company model? Is that still hold or is Google really the core engine that's going to continue to evolve and continue to have ancillary businesses that are, you know, somewhat adjacent to Google? I'll answer two ways, right? So I think

We are not a holding company in the sense that we are not just looking to invest capital in other attractive businesses. That's not who we are, right? We are from a foundational technology basis, if we can take that technology and that R&D we do and identify problems in which we can innovate and bring a differentiated value proposition

We'll do that, right? So that's the way we approach. And so the structure is an outcome of that, right? So, and which means you will have businesses on paper, they may look like very disparate, but there is a common strand underneath them, right? So like,

Waymo is going to keep getting better because of the same work we do in Gemini and AI over time as Google Cloud to search to YouTube to isomorphic to robotics, etc. So that is the unifying layer, right? And then it's a continuum. Is Google Cloud a Google business or an Alphabet business? We segment it out.

And so the branding matters less, I think. We'll have a range of companies. Some of them will leave and IPO out because maybe that's the best way they can make progress. So all of that is a possibility. But what I think

I, the founders, think about it as like the underlying innovation by which. So we think of the units of quantum, right? You know, alpha fold and hence isomorphic, right? You know, self-driving and building the Waymo driver and hence all the businesses on top of it. So it's more maybe that's how we think about it.

Does X still play a big role in driving innovation and you continue to invest there? Yeah, look, I think if anything, X over time, look, a lot of these innovations did come out of X, right? And so including Waymo, the early incarnations of Google Brain, right? Yeah, so I think X as an incubator allows us to push the boundaries they're thinking about.

tapestries, thinking about the grid problem that are extraordinary, but it's all rooted in computer science, physics, kind of a deep technology R&D. And I think that's the foundation across everything we do. As we wrap up, I want to ask you one last question to hopefully frame your experience of the last 10 years as CEO. Biggest regret, biggest mistake, and what you're most proud of.

Look, I think we have, as a company, I think there aren't that many companies which can push the technology frontier. Like you don't hear of companies winning Nobel Prizes often. That level of foundational R&D we do and then apply it to create businesses and value.

I think we have done an extraordinary job at that and we aspire to do that. I'm really proud of that. I think we're pretty unique as a company that way. There are a lot of small regrets. By nature, I tend to look forward and I learn from mistakes we make. But look, there are acquisitions we debated hard, came close.

- Some of them are-- - Just give me one name. - You don't have to. - Or get in trouble. Maybe Netflix, right? Like we debated Netflix at some point super intensely inside. So you go through these moments, right? And so I wouldn't call it regrets, but you always look back and like in a world of butterfly effects, there were alternate paths, but maybe they are in a different part of the multiverse. - Yes.

Yes. I always tell people I think they underappreciate the role that Bell Labs played in driving innovation and ultimately human prosperity in the early 20th century. And I do think a lot of people underappreciate the role that Alphabet is playing in driving innovation across so many different lanes, which drives prosperity, businesses, competition, all that stuff aside, the innovation that's being driven out of Alphabet continues to impress

and benefit us all. And so I want to thank you for your leadership and the time, Sundar. Thanks, David. Real pleasure.