Lights, AI, Action: Wonder Dynamics's Tye Sheridan
27:43 Share

Today, we're airing an episode produced by our friends at the Modern CTO Podcast, who were kind enough to have me on recently as a guest. We talked about the rise of generative AI, what it means to be successful with technology, and some considerations for leaders to think about as they shepherd technology implementation efforts. Find the Modern CTO Podcast on Apple Podcast, Spotify, or wherever you get your podcast.

Job loss from AI gets lots of attention because increasingly capable machines can do more and more every day. But these increasing AI capabilities can also help create jobs. On today's episode, learn how one Hollywood actor is using his industry knowledge to help creators without massive Hollywood budgets. I'm Ty Sheridan from Wonder Dynamics, and you're listening to me, myself, and AI.

Welcome to Me, Myself, and AI, a podcast on artificial intelligence and business. Each episode, we introduce you to someone innovating with AI. I'm Sam Ransbotham, professor of analytics at Boston College. I'm also the AI and business strategy guest editor at MIT Sloan Management Review.

And I'm Sherwin Kodubande, senior partner with BCG and one of the leaders of our AI business. Together, MIT SMR and BCG have been researching and publishing on AI since 2017, interviewing hundreds of practitioners and surveying thousands of companies on what it takes to build and to deploy and scale AI capabilities and really transform the way organizations operate.

Hi, everybody. Today, Shervin and I are pleased to be joined by Ty Sheridan, co-founder and president of Wonder Dynamics. But you may be more familiar with Ty from films like Ready Player One and X-Men Apocalypse and Mud. I did my homework by watching movies over the weekend here. Ty, thanks for taking the time to talk with us. Let's get started.

Thanks so much for having me. And thanks for doing some homework on me, apparently. The homework was easier than usual. Although, I mean, some of the homework involved looking at patents that you filed, which was something I wasn't expecting. So maybe we can get into that too a little bit later. But if we think about a movie like Ready Player One, there's clearly a bunch of AI in the content of that movie. But that's not what we're focusing on here. Tell us about Wonder Dynamics. What's going on with that?

Wonder Dynamics is a company that I started with a friend of mine, Nikola Todorovic. Nikola kind of comes from a background of visual effects. I was a visual effects artist and then later turned supervisor and as a filmmaker as well. For folks listening who don't know who I am, I kind of came up through the world of film as an actor. Got involved in films from a really early age and fell in love with it, but I was always completely obsessed with filmmaking technology and the entire process.

When I met Nicola, we met working on a very small film called Last Days in the Desert. This was over 10 years ago.

And we were both kind of wanting to make our own films one day and knew, you know, we wanted to make big films and knew that, you know, we didn't have the budget to do so, right? And so we really kind of started collaborating together and started developing projects. And then that's when we realized, oh, wow, this is going to cost $150 million. Where are we going to get a check for this? And so that's really where Wonder Dynamics was born, really out of our frustration of trying to make great,

big films and not necessarily having the budget. So Wonder Dynamics' entire mission is to enable indie filmmakers anywhere in the world to make studio level movies with CG effects, but on an indie budget. We do that by using a suite of AI machine learning models running in a platform, which is our flagship platform called Wonder Studio.

which we launched back in July. Wonder Studio is an AI-driven VFX studio. You upload any 2D video and you can extract a lot of data out of that video from

2D pose and the lighting in the scene to the noise and the way your camera is moving. And there's 25 plus machine learning models running in the background. And then we take all that data and we enable it to be exported into 3D software so that artists can continue working in the traditional softwares that they are used to working across the industry.

That makes a lot of sense. So let's go into the cost part, which I think is a pretty fascinating thing. Is that the future of movies, that we're not going to need big budgets? Or is there still going to be room for big budgets? Or how do you see this ecosystem playing out? I hope so. I think that to date, only a certain handful of people or studios have been able to make certain kinds of films. And it's also not only limited by your budget, but it's limited by where you live, right?

If you're not in Hollywood to date, it's been very difficult to break into the industry at that level. And I think that's the real excitement around these new innovations, especially in AI and machine learning, where they pose a huge opportunity to artists and to the industry. I think the industry as a whole is in...

We're going through a rough patch, let's just put it that way. The global box office taking a huge slam during COVID and the quickly evolving landscape of distribution. The industry has been totally shaken up and it's really hard to get any film made, much less a huge $200 million movie with $100 million budget worth of VFX. I do think we're on the cusp of

a new era. And I don't think it's not unlike digital cameras or the advent of the camera itself. You know, technology has been pushing our industry forward since it started. We wouldn't be able to be making the films that we're already making without the certain technologies that we have in the industry currently. Can you walk us through what the normal process would have been and how with Wonders Studios, whether that process is

almost the same, but now without the technological and cost limitations that they would have? Or is this a completely new process from like a user's perspective? Is that like they need to learn something completely new? Or is it almost the same? Just curious how the ways of working of the artist and the creative team is changing because of this.

Yeah, no, it's a good question. So in theory, you could just get a 2D video out of Wonder Studio, right? And for some people, it's going to be good enough for their final VFX. For someone who's not a 3D artist, it might be good enough for if you're a 12-year-old boy and you want to go out and make a sci-fi short film with your friends and have some cool visual effects, that's fine. If you're working on Warner Brothers' science fiction movie, let's just say you're working on Avatar, the next Avatar. Well, you're not going to be able to make a sci-fi short film with your friends.

there's a certain standard, right? And Wonder Studio will only get you a certain amount of the way, right? So you can think about it as your first visual effects pass, right? So getting you 80% there, and then you take what Wonder Studio gives you, speeding up your process tenfold, and then continuing to work on that.

Traditionally, the way it works, and I'm sure, you know, I just mentioned Avatar or you can take movies like Ready Player One, which I worked on that Steven Spielberg directed where we spent eight weeks in motion capture. Traditionally,

the animation is motion capture, right? So you need a huge volume with this Vicon system with infrared cameras and sensors that are basically tracking those little balls that you've seen people wearing with the funny suits. And that's what's giving you your animation data. Now, you still have to go and clean that up. It's not perfect. There's going to be a lot of attributes within the animation data itself, even with that method. But that method is very expensive. I mean, to rent these stages off,

That's why only studios really can do that. And then if you're an animator yourself, I mean, in theory, you could go and you could hand animate this animation, but it takes a long time, right? So what Wonder Studio does

essentially is offering to artists is an avenue of achieving that animation at a super reduced cost. And faster too, probably. And faster, right. Yeah. So you can upload, let's just say a one minute video and extract all the animation data and get to your first pass, quote unquote, of animation in an hour. Yeah.

And it's not going to be perfect in every shot, but it might be pretty darn close in a lot of shots. You know, sometimes it's pretty close to final. But again, you know, Wonder Studio was really not built to replace the process. It's really to supplement the artist process, to speed them up, to create opportunities for filmmakers or storytellers that have a big idea, but don't necessarily have the resources or the knowledge necessary.

to go and see that idea as a reality. Yeah. You know, I'm looking at you in our video Zoom and you're a

young, quite accomplished actor and folks know you from your films and all that, they may not know your background and like the patents and all of the sort of technical stuff that you've been doing. Tell us more how you got into that. And when did you have the time to like learn all these things? And just tell us a little bit more about your technical background and how it came about. Maybe there's a lot of downtime while he's wearing the suit. The truth is, I don't really have a technical background.

You know, I grew up in a really small town in East Texas. And working on films, the idea of that was just so far-fetched. I couldn't even fathom that it was a thing you could do as a job, right? That's how far away from the industry I was.

I really randomly kind of fell into the industry. I got randomly invited to come and audition for this film called The Tree of Life. It was directed by Terrence Malick, but essentially they recruited 10,000 kids in the state of Texas through the public school systems to come and audition for this film. And I just got an invitation and my parents said, oh, well, why don't you go to this audition? You can always tell people that you got to audition for a movie one time. I said, yeah, that sounds cool. Why not?

So I went on a whim. And after a year-long audition process, I ended up getting cast in this film. I was 11 years old at the time. So the first day on the film set, acting was just as new to me as the entire process. And I just became obsessed with it all. So really, I say I don't have a technical background. I do when it pertains to storytelling. I think for me, it's the personal connection between

you know, that's interesting to me. So in terms of like technology that you use in the filmmaking process, I'm all over it. I'm all about it. It's very interesting to me. Everything else is, I love cameras, that kind of stuff. Beyond that, I would say my technical background and knowledge is very, very, very limited. But it's a lot of the design thinking and understanding the pain points and the desirability of a product like this. Right.

Right. And that's been our approach the whole time. You know, Nico and I are artists ourselves. We really have been approaching this as artists, you know, building out of frustration of the process, right? Versus, you know, hey, all these new research models are at a certain place now. And why don't we start a company to generate videos for creatives? We have a very different approach.

We're coming at it from a completely different direction. And I do think that's partly what makes Wonder Dynamics unique in comparison to maybe some of the other generative tools out there or AI-driven products out there. These tools are, I don't want to simplify them and make them sound too easy, but the entry to getting into tools is so much lower than it was before that

Which then lets somebody who has more knowledge of the process come together and create a tool versus having to start in the research lab, like you were saying, Tai. No, it's so true. And look, I mean, Tai, Sam and I have been researching AI and adoption for eight years. And a lot of my work at BCG has been over the last decade and so around implementing AI and coming up with AI strategies for companies and all that. But the missing link has always been

around process, right? It's been data and tech only gets you so far, models and all that. At the end of the day, the biggest lift is you got to change somebody's way of working, got to change the process, all of that. And so if I look back at all of our podcasts, all of our conversations, we always start with, okay, this is this wonderful technology, this wonderful product. How do you get people to use it? Whereas,

Your story is very refreshing where you're starting with a problem, but because technology has become so much more available now than it was maybe a decade ago, the barrier for you to create something that's really disrupting the industry, that's helping, is much lower than it would have been. And it's really, really refreshing. I think we will hopefully see, I think this is such an inspiring story that we're hopefully going to see a lot more of this.

These stories where you actually start from the user and work your way to the technology. I think what we learned is that good technology without good presentation is, it's a wash. So I want to ask you something maybe a bit more philosophical or existential. That is, we're seeing these technologies advance quite rapidly.

rapidly at a much more accelerated pace than they used to before, right? I mean, it took over a decade for computer vision to get good enough. It took less than a half a year for large language models to really, really get super cognitive and able to understand and have logic. So if you play that forward, you know, three, four or five years from now,

Clearly, it is encroaching upon a whole bunch of things that we used to say these are like uniquely human things, including the creative process, including the open-ended brainstorming things. And we've seen images and videos created by these large language models. We've seen poetry and just entire like scripts and movies and all that. So my question is, how do you see the future and the human role in the creative process itself?

And the second part of that question is, do you think there should be some hard regulators or limiters in what should be allowed? It's a good question. I mean, I think we often get so caught up in what's happening in our day to day and what the new tech is and how it's affecting things. And I think we forget fundamentally as a species, we build tools. We build tools. That's what we do. They make our lives easier and our survival rate goes up.

And essentially, that's what we're doing. And I don't think you're ever going to stop that. That is our nature to keep continue building tools to, I guess, make our lives easier. Right. But it makes sense for people to get defensive about something that so quickly has changed fundamentally society.

the entire ecosystem or the landscape of an industry has the potential to fundamentally change the landscape of an entry. It's scary. That's our natural kind of mechanism is to be defensive, right? But I think

The more important thing that we should all be doing, I think, is having these conversations, you know, talking, posing the exact same question you just posed to me back at all of your friends and your family and your coworkers and thinking about, well, what does the future look like? And I'm glad you said three, four, five years, because beyond that, who knows? It's all moving so rapidly. In terms of regulation and how we balance this innovation with

Trying to maintain the integrity of industries and people's livelihoods is a very, very difficult question. I do think we have to be cognizant of it and we have to be approaching it ethically and very, very thoughtful as innovators, the effect that it will have on society as a whole.

That's super important. But I think for me, you know, I try to look at these things optimistically and look at the ways that it can improve people's lives, create new possibilities. You know, I think people had a similar reaction when the Internet came about. Yeah, it's not our first time around. Yeah, exactly. Not our first time around. We've had technologies that have come into play and shaken up our world in a huge way, but they also created a lot of new opportunities.

I'm really excited about a future where our lives are better and where technology makes our lives better. And yeah, I also think today we're so immersed in our own technology devices. But I'm curious, like, does AI, you know, alleviate some of that and in some way allow us to have more human connections? I don't know.

I think we're all kind of hoping that. You mentioned the time factor. We're all crunched on time and we're back to back scheduling things and it has to help out there. At the same time, there's some other startup out there right now who is thinking about eating your lunch too. And that's the perpetual dynamic there. There's another technology coming along the pike. How do you think about both of those things? I mean, it's a great question. I was in a really interesting place during the strikes in the industry.

A big point of contention was around AI. Of course, with the advent of Chad GPT and some of these large language models, writers were very, very concerned. And I think the Screen Actors Guild became very concerned that studios would take someone's likeness and then just go make movies with that likeness without the artist involved.

And I think, one, looking at it from the outside, I think there was a lot of misunderstanding of like what was currently possible, right? I think that people were giving a lot of credit to technology that maybe existed, but in its infancy still. But regardless, fundamentally, we're right to be concerned about artists and thinking about how this is going to impact their careers and their lives. I think that was a really important

Good example. I think we'll continue to see that conversation evolved. And yeah, I was in a really interesting place because, you know, co-founder of a company that's technically building AI driven production tools. And then I'm an actor as well. I think for us, you know, we've always...

really been thoughtful about that, that we wanted to build tools for artists and not encroach on their process. Beyond that and building a great brand, if you can get in the artist's corner and build something that they love and they find very useful and continue to expand on that and continue building, I think it's, I guess, really the only way to stay competitive. Yeah, I think everyone's facing that. I think you said something quite...

simple and quite deep that sort of brought this all back to our humanity. That is like, we build tools, right? We've been building tools all of our evolution. And this is not the first time we've built a tool that could potentially be dangerous. I mean, you think about the automobile and the electricity and all of it, right? All of it. Like, you know, when have we, there's always been a trade-off between the power of the tool and

and the unintended consequences, the harm it could have done. And we've threaded that with some dialectic process over time, not always gotten it perfectly, but we've sort of always landed. There's a futurist optimist view here that says like, there is actually no reason we would not expect the same here this time around, right? Predictive analytics says we're going to have this, we're going to come out all right. That's right. That's right. Yeah.

So, Todd, we have a segment where we're going to ask you a bunch of rapid fire questions to kind of close this out. OK. Short answers are fine. What's the biggest opportunity for artificial intelligence right now? I always go back to the humanity thing and human experiences to have better human experiences and live in a world where people are happier. People are more loving to each other. People understand each other.

more. I think that is the biggest opportunity with AI. And I think that's why, you know, storytelling is important to me. That's why I'm completely obsessed with it. One of the most important tools we have is telling stories because it allows us to understand each other. It allows us to connect in a realm that's some in-between world, right? Where there's

Two minds coming together and colliding with the same idea in a union of understanding. And that is powerful. So AI-driven storytelling, obviously, it's an interest of mine, but I'm really excited about the opportunities there. And your point, I mean, you're building tools that can make more people tell better stories. So what's the biggest misconception that people have about AI? Well.

Well, there's a lot of misconceptions. But I'll just say specifically in the film industry, that it's going to replace everyone overnight, that it's going to replace the creative process. And I don't necessarily believe that. Artists are essential. And I think there's something innately human about that creative process that's hard to replace. So growing up in Palestine, Texas, what was the first career you wanted?

You said you didn't want to be a film star. I didn't think that was a possibility. What did you want to do? I wanted to be a baseball player. I played year round pretty much until I was about 16. And then I kind of had to choose. You know, I remember I had to choose between the film thing and baseball. I just didn't have time anymore to do both. And

It was the right decision. I was never going to make it as a baseball player. You don't know that. Yeah, yeah, that's true. That was decent. Not, yeah, probably not all-star level. Okay. So when is there too much artificial intelligence? When are people using the tool in places that they shouldn't?

When we're all gone. When your first scenario doesn't play out. Yeah, exactly. So when is there too much artificial intelligence? Yeah, I think like when we're all sitting at home and not doing anything, not having any outside experience. Actually, I wasn't thinking about this, but that's a perfect tie-in for Ready Player One. I know that you end that movie by turning off the OASIS two days a week. What's one thing you wish that AI could do that it currently can't?

Oh, man, that is a great question. Printers, printers, if I could just make printers, the whole printing ecosystem easier, that would just really save a lot of people some frustration. We haven't heard that one. That's a good one. It's been great talking to you. I think one of the things that you've really brought out is this idea of enabling a creative process versus replacing. And so much of the discussion is about replacing and, you know,

this replacement thinking. And, you know, you really point out how it'd be a real enabler for human experiences. And we appreciate you bringing that to our show. Thanks for taking the time. Thank you guys so much. Yeah. Thanks for having me. It was a lot of fun. Thanks for listening. On our next episode, Sam and I speak with Paul Romer, former chief economist at the World Bank and director of Boston College's Center for the Economics of Ideas. Please join us.

Thanks for listening to Me, Myself, and AI. We believe, like you, that the conversation about AI implementation doesn't start and stop with this podcast. That's why we've created a group on LinkedIn specifically for listeners like you. It's called AI for Leaders. And if you join us, you can chat with show creators and hosts, ask your own questions, share your insights, and learn more about AI.

and gain access to valuable resources about AI implementation from MIT SMR and BCG, you can access it by visiting mitsmr.com forward slash AI for Leaders. We'll put that link in the show notes and we hope to see you there.