‘Distillation’ Is AI’s New Buzzword—and a Scary One for AI Companies
12:06 Share

ADP knows any big thing, any small thing, any trendy thing, even a trendy thing that everyone knows isn't a great idea, but management just wants us to give it a try for a bit can change the world of work. From HR to payroll, ADP designs forward-thinking solutions to take on the next anything. Welcome to Tech News Briefing. It's Thursday, February 6th. I'm Pierre Bien-Aimé for The Wall Street Journal.

Amazon may be number one in online retail, but its bricks and mortar stores aren't doing quite as well. We'll talk to real estate reporter Kate King about the company's decision to shut some of its storefronts. And DeepSeek, the buzzy artificial intelligence company out of China, may have trained one of its models by having it ask questions of its American counterparts. Tech reporter Myles Krupa says so-called distillation has some investors spooked.

First, after a decade-long experiment with real-life stores, Amazon is pulling back. In recent years, the e-commerce company has closed all kinds of shops. Its portfolio of Amazon Go convenience stores, where you can just grab an item and walk out and you'll be charged electronically, has shrunk by about half since early 2023 to 16 stores in four states.

Sales at its stores, including Whole Foods Market, have grown annually, topping $5.2 billion in the third quarter of 2024, but that compares with about $61.4 billion at Amazon's online store.

Kate King covers real estate for the Wall Street Journal, and she joins me now. Kate, Amazon Go stores, they do seem pretty innovative. There's no traditional checkout counter, so there's no line, and no one likes a line. They use these cameras and sensors to track your purchases. Are customers just not into it?

I'm sure some are for sure. I did interview one person who said that it was convenient in the moment to go into the store and walk out without waiting in line, but it didn't necessarily change his life. And he said that while maybe he saves a few seconds not having to pull out his credit card, paying by credit card is so quick now, especially with Apple Pay, which allows you to quickly just scan with your phone at the checkout aisle. So for him, it wasn't a huge game changer. And it's not just Amazon Go stores, right? Yeah.

Amazon's tried a bunch of different bricks and mortar concepts. That includes, of course, their bookstores, which they started with about 10 years ago in Seattle, their four-star locations, which were stores that were stocked with their best-selling items from the website. They had their Amazon

Amazon style stores, which were basically fashion stores with a lot of technology. And of course, they have their grocery portfolio. And the other types of bricks and mortar stores, the bookstores, the four star, the fashion stores, Amazon has closed and kind of abandoned those projects. What they're really focusing now on

on is their grocery portfolio. Namely, Whole Foods, which it owns. Yes. Amazon bought Whole Foods Market in 2017 for over $13 billion, and it's doing really well. Sales are growing. It's expanded the locations of Whole Foods. And Amazon also has launched a concept called Amazon Fresh, which is a high-tech grocery store. It sells a lot of mass market items.

items at maybe more affordable prices than you'd find at Whole Foods, and it uses technology. And here, Amazon's really experimented and made some major changes. When it first opened the Amazon Fresh stores, they had the Just Walk Out technology that you see at Amazon Go convenience stores.

But this didn't really work. And so they paused expansion of Amazon Fresh. They removed the Just Walk Out technology. And now they have shopping carts that are equipped with scanners. So when you pick up an item off the shelf, you scan it, you put it into the cart. And even some of the harshest critics that I interviewed do say that the Amazon Fresh redesign has worked. But at the same time, it remains to be seen how successful it will be in terms of growth and customer adoption.

So is Amazon scrapping its Just Walkout tech? Amazon is still using its Just Walkout technology. While it might be walking away or paring down its focus on the Amazon Go stores, it's not reducing its emphasis on Just Walkout technology. Amazon licenses this technology to over 200 third-party retailers. That includes colleges and universities, hospitals, those convenience-type stores in airports, restaurants.

And someone I interviewed who was really critical of Amazon's physical location said Amazon Go, while it didn't really work as a standalone store, it wasn't a waste of time or money because it allowed Amazon to really research, develop and refine this technology, which it's now selling to other retailers.

That was our reporter, Kate King. Coming up, training cutting-edge AI is massively expensive. But if the next best AI models are super cheap, where does that leave the pioneers and their investors? That's after the break. ADP imagines a world of work where smart machines become too smart. Copier, I need 15 copies of this. Printing. By the way, irregardless, not a word, Janet. Yeah, I know.

Page six should be regardless of or irrespective of. Just print them, please. If it were a word, Janet, it would mean without irregard, which is... Copier! Switch to silent mode. Let's put a pin in it. Anything can change the world of work. From HR to payroll, ADP helps businesses take on the next anything.

The Chinese company DeepSeek turned heads last week with a powerful problem-solving AI model, R1. And it was a lot cheaper to make than models made by deep-pocketed American companies. But could DeepSeek have piggybacked on other artificial intelligence? That's the idea behind distillation. By drawing on the results of others' work, distillation can create a model that's almost as good quickly and more cheaply.

OpenAI, the maker of ChatGPT, says it's seen indications that DeepSeq distilled from the AI models that power ChatGPT. DeepSeq didn't respond to emails seeking comment, but the company has said it used distillation on open source AIs released by Meta and Alibaba in the past. Myles Krupa covers tech for the Wall Street Journal, and he joins me now to talk about this. Myles, how does distillation work? It's basically taking the outputs of one AI model

and using that to sort of teach another one how to solve problems and ask questions. And so it's actually a technique that's been around for a while in AI. We've seen examples of distillation in the past from big US AI labs, but DeepSeek certainly is making everybody much more aware of the practice now. Ali Godsi, who runs this company called Databricks that does a lot of AI work,

He compared distillation to basically getting to ask any question you want of Einstein and becoming almost as knowledgeable as

as he is in physics. That's what the process looks like for these AI models. And we should quickly note that News Corp, owner of the Wall Street Journal, has a content licensing partnership with OpenAI. Miles, we reported that OpenAI is probing whether DeepSeek used its models to train its chatbot using distillation. That's right. OpenAI began as this company that wanted to democratize AI research and make it available for all as part of its mission, and over time has gotten a lot more

closed in terms of protecting its IP. It stopped sharing as much research. And that's true of a lot of AI labs. But open AI in particular is very sensitive to its trade secrets, or it's the technology that it spent billions of dollars to create.

being improperly used in competing AI, as DeepSeek appears to have done, according to OpenAI. And how effective has distillation proven to be so far from what we've seen? It appears to be really effective. It's an easy way for smaller developers in particular to recreate some of the capabilities of much larger models.

in a much more cost-efficient manner and doing it in a way that also produces AI models that themselves are a lot smaller and more cost-efficient. So if distillation works so well, what effects could that have on the hyperscalers, the companies that are pouring vast sums into AI and their investors? Yeah, it just puts even more pressure on them

To stay at the cutting edge to justify the billions of dollars they're spending, it just raises the question of what's the point if everything can be replicated so quickly and so cheaply? I mean, it was a matter of months between when OpenAI announced this model called O1 and

That was a very powerful model. It's something called reasoning. And then a few months later, DeepSeat came out with its own version, R1, that was basically just as good. And so when investors are looking for justification,

And in fact, overall, what could this do in the arms race in terms of changing the costs of AI?

A lot of people are talking about the commodification of the AI models that power things like chat GPT, that basically all of the sort of secrets are going to become secret no longer. And open source developers like DeepSeek will only sort of increase the pace of replication and innovation. And that will all help to drive down costs in the underlying technology. That's

where a lot of people see the puck traveling. OpenAI's terms of service forbid using its AI to develop rival products the way that OpenAI alleges DeepSeek did. But can OpenAI really do anything to enforce that? Yeah, it's hard. They said that they've closed down an account they believe was tied to DeepSeek. So that's sort of the only real mechanism. It's like a game of whack-a-mole, right? Because if you close down one account, somebody can always open up another one. But speaking to people about this, it sounds like

The way companies like OpenAI and Google provide their AI models through what's called an API, it's very hard to prevent upfront the sort of misuse that OpenAI is alleging. That was our reporter, Myles Krupa. And that's it for Tech News Briefing. Today's show was produced by Julie Chang with supervising producer, Catherine Milsop. I'm Pierre Bien-Aimé for The Wall Street Journal. We'll be back this afternoon with TNB Tech Minute. Thanks for listening.

ADP knows any big thing, any small thing, any trendy thing, even a trendy thing that everyone knows isn't a great idea, but management just wants us to give it a try for a bit can change the world of work. From HR to payroll, ADP designs forward-thinking solutions to take on the next anything.