(Preview) The End of OpenAI and Microsoft, Risks and Rationale of the Stargate Project, DeepSeek-R1 and Bitter Lessons for the Future
13:59 Share

Hello and welcome to a free preview of Sharp Tech. Hello and welcome back to another episode of Sharp Tech. I'm Andrew Sharp and on the other line, Ben Thompson. Ben, how you doing? Doing okay, Andrew. How are you? How is Washington, D.C.?

Washington, D.C., beginning to calm down. There are fewer military checkpoints in my midst as everybody makes their way back to wherever they came from a week ago. So I have no complaints. It's still unbelievably cold here, but you'll probably call me a pansy because you know real cold in Midwest Wisconsin. But other than that, you know, life is good. Good. I'm glad to hear. I'm

The trials and tribulations you bear, we all respect it. That's right. Well, and you know what? Our colleague, Duman, before we came on to record, informed me that this is our 200th episode of Sharp Tech, which is kind of amazing. 200 big ones. Do you have any deep thoughts to mark the occasion or should we just keep it rolling? No thoughts at all. Sorry, I got nothing for you.

Okay. My only thought is that the next 200 episodes will probably be much crazier than the last 200 episodes, as exemplified by this week's news. So, Ben, on that note, here we go. I pulled a number of thought-provoking tweets for today's rundown. We're going to start with a pair here. What's a tweet? One...

A post, a post on X is what I pulled for our rundown. Thank you. I'm going to improve the nomenclature for the next 200 episodes together. No, we can call it tweets. We'll call it tweets. That's right. We're boomers here on this podcast. That's right. OpenAI on X.

Tuesday afternoon posted, the Stargate project is a new company which intends to invest $500 billion over the next four years building new AI infrastructure for open AI in the United States.

We will begin deploying $100 billion immediately. This infrastructure will secure American leadership in AI, create hundreds of thousands of American jobs, and generate massive economic benefit for the entire world. This project will not only support the reindustrialization of the United States, but also provide a strategic capability to protect the national security of America and its allies."

The initial equity funders in Stargate are SoftBank, OpenAI, Oracle, and MGX. SoftBank and OpenAI are the lead partners for Stargate, with SoftBank having financial responsibility and OpenAI having operational responsibility. And then a follow-up tweet from a user named Tane Jaipuria says,

He says, wow, Stargate project will invest $500 billion over the next four years. That's about 0.4% of US GDP over that period. For comparison, the inflation adjusted dollars spent on other large undertakings, the interstate highway system cost about $650 billion. The Apollo program cost about $280 billion. The Manhattan project cost about $35 billion. Wow.

So Ben, Stargate is a fun name for a massive AI project, so I support it on that basis. But from a practical standpoint...

I'm not clear on what's trying to be achieved with Stargate and why it's altogether different than what these companies have already been pushing toward for the last few years. Well, that is a good point, which is this partnership between Oracle and OpenAI is not new. It was sort of announced last summer, and it was notable at the time because OpenAI partnering with an infrastructure provider that was not Microsoft, right?

And I wrote about it –

not exactly at the time, but sometime in the fall, it ended up being that Microsoft was going to like run or they had some sort of role. It would still be like an Azure cloud or something along those lines. But there was a clarifying open AI tweet at the time, which is, oh, all our training loads continue to run on Microsoft infrastructure. And, you know, I got to pull up my inner pedant, pedant, pedant. I don't know how to say that word. Pedant. I wasn't even close. That's unfortunate. Yeah.

But you are a pedant. It's not all that inner, actually. Yeah, well, that's just a sop to all our pronunciation pedants in the audience. That's right. It was in the present tense. It was not in the future tense. And it's hard to sort of talk about this and think about this independent of...

of the Microsoft angle here, which you go back to what OpenAI used to be, which was this sort of research team with this goal of achieving AGI. They realized they need a lot of money to do so. Microsoft's like, well, we could really use these sort of models along the way. That's cute. You have your API. Startups can use it. But

Big companies are going to want to sort of work with us. So we'll, we'll also have the API. We'll give you money and you basically are our research team and we will, we will reap the benefits. And I was sort of thinking about the course of this relationship and we've talked about

obviously about the open AI board drama and everything that went down then. And it's easy to point to that as when this relationship sort of started to fall apart. But I think it's the more I think about it, it's one of those stories that is very appealing to humans because there's a clear sort of narrative arc. Oh, they had this beautiful partnership and open AI sort of couldn't get their crap together because they had this weird sort of arrangement. And, um,

Suddenly it starts to come apart. But a lot of big shifts, I think, end up being more structural than necessarily sort of cute stories, as it were. And the real split was a split that no one realized was a split at the time, which was ChatGPT.

the chat GPT. And I sort of called this pretty early on really fundamentally changed the trajectory of open AI. Like, like I called them the accidental consumer tech company. And I, and I think a lot of this stuff that's happened at open AI, not including the board thing, but also the departure of lots of folks is, uh,

it's a transformation of this company to suddenly having an opportunity to pursue the biggest opportunity that exists, which is being one of the big consumer tech companies. Like there's very few of them, right? There, there, there's Apple. There's really Apple, Google, and Facebook are at Microsoft's an enterprise company. Uh,

Amazon is a consumer tech company, but it's an e-commerce site. It's not a platform in the way we think of the other ones. Or just think about OpenAI. You go to ChatGPT and you use it and they develop features and you're on there. And those sorts of companies...

Sort of by definition, and you think about like my aggregator sort of framework where they marshal demand, they are at the top of their value chains. Everyone that interfaces with them exists to serve them. Apple's developers exist to serve them. Apple's supply chain exists to serve them. Apple brought in their own sort of processor technology for themselves. Like Google...

The websites of the world exist to serve Google. They have special maps on their site just so Google can sort of map them more accurately. The whole SEO industry is a somewhat perverse version of serving Google, right? Like all these influencers, all this content is there to serve Facebook because those –

Amazon suppliers, if you want to go there, they exist to serve Amazon and they get really upset about this and frustrated about this, but it is sort of an inevitable outcome when you sort of control demand. And in this context, right?

Microsoft is not particularly interested in being a servant. That's not what they do. They were there for the technology. They were there for OpenAI to serve them, not the other way around. And in this sort of context, you look back at ChatGPT, which no one expected to be what it was. OpenAI didn't expect it. Microsoft didn't expect it. Again, it was this accidental tech company. And that...

Once that happened, once this sort of course was set, this sort of long-term dissolving of the relationship, which is not going away. Microsoft still has exclusive access to the OpenAI API, which is what they want. A lot of inference is still going to run on Azure. Microsoft going forward has the right of first refusal. If OpenAI wants cloud capacity, Microsoft could say, yeah, run it on ours or run it somewhere else. But it's not what it was. And in retrospect...

That was inevitable. Rendered impossible because chat GPT changed the nature of what open AI was going to be and was trying to do. Is that right? That's right. That's right. It just it was it was always going to be sort of sort of incompatible in that regard. So I think that that's the broader context difference.

to sort of think about sort of what's happening here. So, so you have, right. And I want to come back to that though, but just as far as Stargate specifically, like I'm trying to determine what it actually means and whether it's real progress and meaningful to the long-term future of AI in America, or if it's,

Essentially, the announcement this week, I don't know why this was announced from the White House, because the government doesn't seem to be all that involved in it. Is this the next stage in the never ending shell game that Sam Altman may or may not be running on the entire world? Like, how seriously should I take that announcement? Well, just so you have open AI that has this grand opportunity to.

And I was obviously married to grand ambition. The grand ambition has been there for a long time. Sam Altman is anything – is nothing if not grandly ambitious I think is a way to sort of put it. And good at marketing those ambitions, yeah. Absolutely. So you have this by and large this sort of inevitable split, and you have still this dream of AGI. Yeah.

And ASI sort of beyond that. And what we've – what you're sort of seeing, and we're going to talk sort of about DeepSeek and things sort of later on, is we're seeing the manifestation of a lot of the ingredients that were sort of predicted and talked about in what will enable sort of AI to take off. So first and foremost, you have like –

you had this model sort of challenge, where's the data going to come from once we've sort of harvested the whole internet or in all, you know, whatever we can sort of get our hands on. Well, AI can create data for itself, right? Like, and so you're starting to see this cycle sort of manifest. This seems to be a core component of, you know, you know, of some of the, these more reasoning models, uh,

And so the question was, would synthetic data sort of work to build this? Well, it does seem like it's going to work. And so suddenly you're needing huge amounts of capacity, not just to train new models, but to train the models that train the models and to have these sort of iterative passes and things along those lines. Right.

And you have this goal and this ambition married to this entity that it's sort of core supporter, it's core infrastructure provider. It's not that they don't want AGI, it's that they're sort of

is governed by the need and desire to serve their existing customers. This goes back to our discussion last week. Are those existing customers going to be on the leading edge of all this AI sort of stuff? If you ask them, of course they'll say yes, but the reality of these being human organizations organized around the old way of doing things is that it's going to be sort of a long slog. You have Microsoft talking about, yes, of course we're going to keep investing, but

our rate of investment in training is going to be gated by the inference demand. Like how much, like to what extent do our customers want inference computing is the extent to which we'll invest in training. And that's a very telling statement because it's sort of backwards looking in a way. It's, it's where, you know,

Open AI's view is not that we're governed by inference, what people use today that will guide our investments going forward. It's that we are pushing forward because we see this end in sight and we want to accelerate and sort of lean into it.

And so there's a bit where this overall setting aside the numbers and what's involved, it just makes much more sense, this sort of structure in sort of multiple regards. So number one, Stargate is this independent entity. It's not OpenAI. It is a different company of which OpenAI is an equity holder. And it sounds like they're not putting much money in. They're just putting in sort of operational expertise, but

you know, SoftBank's, you know, in charge of getting the money, which is a different question. All right. And that is the end of the free preview. If you'd like to hear more from Ben and I, there are links to subscribe in the show notes, or you can also go to sharptech.fm. Either option will get you access to a personalized feed that has all the shows we do every week, plus lots more great content from Stratechery and the Stratechery Plus bundle.

Check it out. And if you've got feedback, please email us at email at sharptech.fm.