Mustafa Suleyman on Copilot Vision, AI Companions, Infinite Memory, AI Agents, and more

WEBVTT
00:00:00.040 --> 00:00:04.669
Things that really stood out to me as well just talking with Copilot Vision was how personable it really was.
00:00:04.709 --> 00:00:06.549
It really did feel like that friend.
00:00:06.549 --> 00:00:07.990
He even gave me like some sass.
00:00:08.028 --> 00:00:10.230
Like, oh, I don't, I don't really like this place.
00:00:10.269 --> 00:00:12.050
And it's like, oh no, this place is pretty nice.
00:00:12.109 --> 00:00:15.409
That's a profound moment because a true friend would do that.
00:00:15.419 --> 00:00:20.149
No one wants like a sycophantic AI that just always mirrors you and always obeys you.
00:00:20.519 --> 00:00:21.859
It's not going to be interesting for very long.
00:00:21.859 --> 00:00:35.490
And if you think about how much time we spend on our laptops and phones today, we've created this entire arbitrary, made up graphical user interface to accommodate for the fact that computers are too dumb to understand the words that are coming out of my mouth.
00:00:35.570 --> 00:00:37.049
That is all going to get washed away.
00:00:37.128 --> 00:00:43.149
Now, your AI, your co pilot, is clearly going to understand everything that you're bringing to the table.
00:00:43.259 --> 00:00:46.378
Your emotional state, what you need to get done that day.
00:00:46.594 --> 00:00:48.795
Your interests, your hobbies.
00:00:48.875 --> 00:00:50.354
It's more than just an interface.
00:00:50.784 --> 00:00:58.024
It is a new plane of connection, and it's going to feel like a new digital species, and it's a magical experience.
00:00:58.844 --> 00:01:00.624
Thanks so much for joining me today, Mustafa.
00:01:01.304 --> 00:01:05.594
Obviously, there's a ton of news coming out for Microsoft AI today, so I'm gonna get right into it.
00:01:05.674 --> 00:01:11.825
First, can you give us a quick rundown of everything that was released and why this is an important moment for AI?
00:01:12.655 --> 00:01:18.403
Well, I mean, I guess the first thing to say is that we are on a mission to create a true AI companion.
00:01:18.894 --> 00:01:23.424
And to me, an AI companion is one that can hear what you hear.
00:01:24.189 --> 00:01:43.730
Um, and see what you see and live life essentially alongside you, um, you know, your AI companion will be able to remember, uh, everything that you've talked about session to session, understand the content of the web pages that you browse, um, and be able to talk to you just like I'm talking to you now.
00:01:43.730 --> 00:02:05.963
So it's going to have this seamless, Fluid, very, very smooth conversational interaction and that part of it, you know, the first version of the voice is already out, but, um, in the next couple of days we're launching, uh, vision, which we announced a few weeks back and and is really a magical experience and it is quite different to any kinds of A.
00:02:06.103 --> 00:02:06.254
I.
00:02:06.254 --> 00:02:10.685
Or even general kind of computer interaction experiences that we've seen before.
00:02:11.094 --> 00:02:20.939
Uh, it feels Like a new interface to be able to make an ambiguous reference to what you see on the screen and be like, Hey, co pilot.
00:02:21.110 --> 00:02:21.770
What is that?
00:02:21.909 --> 00:02:22.840
That doesn't make sense.
00:02:23.110 --> 00:02:24.149
Describe that to me.
00:02:24.218 --> 00:02:25.439
This is kind of interesting.
00:02:25.919 --> 00:02:36.229
Um, that the use of this or that, because you know that co pilot can see what you're currently seeing, um, is, is really a fundamentally different way to interact with computers.
00:02:36.229 --> 00:02:37.210
So I'm very excited about it.
00:02:37.500 --> 00:02:37.729
Yeah.
00:02:37.729 --> 00:02:38.930
Co pilot vision is.
00:02:39.289 --> 00:02:46.080
a huge breakthrough and I was lucky enough to get access before this interview actually and it got me incredibly excited.
00:02:46.090 --> 00:02:54.379
So really particular kind of use case that really opened up to my eyes to like the technology and the use cases is actually just travel plans.
00:02:54.379 --> 00:03:08.155
So a real world use case is I'm actually traveling to Switzerland in a couple months and I went up Airbnb to look for a place and I just asked Copilot, I'm like, Hey, Where are the nice areas of town that I should look for?
00:03:08.155 --> 00:03:11.004
And we're kind of the places I should try to avoid.
00:03:11.435 --> 00:03:22.375
And it just kind of like instantly started guiding me through the entire map, giving me suggestions of like particular parts of the city that I should check out, like by the lake or, uh, by the specific restaurant.
00:03:22.405 --> 00:03:22.894
And then.
00:03:23.854 --> 00:03:33.365
It got even crazier when I clicked into the actual places and I scrolled through the reviews super quickly, like too fast for me to even read a single review.
00:03:33.664 --> 00:03:39.623
And I just asked it, I'm like, Hey, um, what are some things I should look out for based on these other people?
00:03:39.623 --> 00:03:40.544
And what are they saying?
00:03:40.854 --> 00:03:44.965
And it just gave me this list of like potential cons of a place.
00:03:44.965 --> 00:03:45.534
And it like.
00:03:46.055 --> 00:03:49.044
It opened up my eyes to like how, how valuable this is.
00:03:49.044 --> 00:03:52.485
Cause I could not read that fast and copilot just summarize it instantly.
00:03:52.925 --> 00:03:58.205
And, um, I'm just like super excited for like potential use cases of this and what other people are going to find.
00:03:58.644 --> 00:03:59.304
Um, but.
00:04:00.074 --> 00:04:02.384
Enough of like my initial reactions.
00:04:02.465 --> 00:04:18.803
Um, I'd love to hear from you what kind of use cases do you think this is going to really solve and are there any like practical things you and the Microsoft AI team has kind of Tinkered with internally that is kind of like really exciting to you Well, I think the one that you mentioned is is a genuine one, right?
00:04:18.824 --> 00:04:30.350
Like reviews are super important whether you're buying a washing machine or a car You know, or trying to book a holiday and, you know, traditionally forums have been the place for that.
00:04:30.569 --> 00:04:38.478
Um, reams and reams of detailed, you know, sort of very technical, quite niche, uh, interactions.
00:04:38.569 --> 00:04:47.499
Um, you know, probably intermixed with a bunch of trolls who, you know, are kind of like ranting at each other for, you know, hot takes on all kinds of things.
00:04:47.529 --> 00:04:54.480
And so they're really, really important and it contains tons of important information, but at the same time, they're really tiring for us to.
00:04:54.694 --> 00:04:57.665
You know, like read that most of us are too lazy to go through all of that.
00:04:57.694 --> 00:05:02.745
So the cool thing about the copilot vision experience is that it has three components.
00:05:02.745 --> 00:05:04.774
There's firstly the underlying LLM.
00:05:04.774 --> 00:05:07.925
So it has all the knowledge of those reviews from across the web.
00:05:08.524 --> 00:05:13.093
Second is it pauses the text on the page that you're reading instantly.
00:05:13.244 --> 00:05:15.194
So you don't even have to scroll down.
00:05:15.613 --> 00:05:18.375
It actually just absorbs everything that's on the DOM straight away.
00:05:19.160 --> 00:05:23.160
And then third, it, um, sees exactly the image that you're looking at.
00:05:23.240 --> 00:05:45.115
So let's say that you wanted to go, uh, move into a new apartment, you're looking for furniture, you know, it's quite difficult if you're not like a expert and you don't, you don't know the language of soft furnishings or fashion, you know, um, to describe exactly what you're seeing on the page, let alone have a strong opinion about, you Whether you like it or not.
00:05:45.954 --> 00:05:58.264
And so a big part of having an AI companion is having a kind of expert support in your pocket, giving you advice, giving you a feedback, um, you know, just co describing what you see.
00:05:58.783 --> 00:06:03.254
Um, and I think that feels very different to any other kinds of experience that we've had, um, previously.
00:06:03.853 --> 00:06:04.053
Yeah.
00:06:04.053 --> 00:06:08.923
How does, how deeply does Copilot Vision kind of understand you as a user?
00:06:09.454 --> 00:06:10.495
Like, my question is.
00:06:11.230 --> 00:06:15.879
How long until it truly starts memorizing, learning you as a user over time?
00:06:16.689 --> 00:06:17.089
Yeah.
00:06:17.089 --> 00:06:17.728
Great question.
00:06:17.740 --> 00:06:21.019
Memory is the key thing that is coming soon.
00:06:21.129 --> 00:06:41.288
Um, you know, not, certainly not this year, but we are working on it as a number one priority because, you know, it's super important that it remembers what your preferences are, um, and is able to kind of reason over them and give you, um, advice based on the fact that it knows that you, um, Really don't like modernist, you know, furniture.
00:06:41.709 --> 00:06:45.408
You like more traditional stuff or you're really not into big, bright, bold colors.
00:06:45.418 --> 00:06:48.809
Because last time when you talked about those curtains or that sofa.
00:06:49.319 --> 00:06:52.370
All those clothes, you know, you were kind of eked out by it.
00:06:52.439 --> 00:06:57.750
So that is, I think, going to be a real, like, big breakthrough when it comes.
00:06:57.809 --> 00:07:06.730
But, um, even like now, it's just fun to kind of co browse or co explore the digital world with your co pilot.
00:07:06.865 --> 00:07:18.334
You know, um, and you know, I think whether it's like both reading the reviews on the page or looking at the images while you're scrubbing through an Airbnb and you're trying to decide, you know, it's a big expense, right?
00:07:18.334 --> 00:07:23.555
You're gonna spend a few hundred dollars a night, perhaps maybe more, maybe less, and you've never been there.
00:07:23.555 --> 00:07:26.095
And all you have is like 20 photos to read.
00:07:26.095 --> 00:07:30.444
And You know, making that decision independently is kind of tricky sometimes.
00:07:30.454 --> 00:07:38.055
So, um, having, uh, you know, co pilot be there to think out loud with you, you know, that's the sort of the way I think about it.
00:07:38.055 --> 00:07:44.504
I think it is a kind of sounding board for you to make sense of everything that you see.
00:07:44.720 --> 00:07:46.040
In your visual experience.
00:07:46.100 --> 00:07:53.069
Um, and we've seen particularly on some of our experiments that we've been doing internally on social media, like instagram and so on.
00:07:53.529 --> 00:08:04.430
People really appreciate being able to scroll through, um, you know, their feeds of various kinds and when they laugh at something or when they're kind of surprised by something.
00:08:04.853 --> 00:08:13.793
Or, you know, when they're a bit like kind of disgusted by something, you know, just having your co pilot there to kind of also share in that experience is, is, is pretty cool.
00:08:14.454 --> 00:08:23.853
So obviously Microsoft is a major investor in OpenAI and Chachapiti kind of has this yet to be released kind of teased version of their vision product.
00:08:24.375 --> 00:08:29.745
Um, how is Microsoft AI differentiating itself from other competitors?
00:08:30.134 --> 00:08:33.783
Um, the main thing is that we're really leaning into the idea of it being a proper companion.
00:08:35.100 --> 00:08:43.299
So just the fluency of our voice and how smooth it is, how fast it is, it's very interruptible, very easy to talk to.
00:08:43.610 --> 00:08:47.370
A lot of people have like remarked on that and that's very deliberate design intention.
00:08:47.879 --> 00:08:52.078
Um, putting vision inside of the browser is the next step.
00:08:52.168 --> 00:08:54.649
And, um, so now in Edge just having it.
00:08:54.979 --> 00:08:58.169
With you all the time able to kind of watch and learn and talk to you about.
00:08:58.169 --> 00:09:02.129
That is a really big differentiator, which I think those guys don't just have yet.
00:09:02.429 --> 00:09:12.519
But I mean, fundamentally, the way to think about it is that there's just a small group of us that are really innovating at the frontier, and we're all pushing the envelope here and going as fast as we can to pull all these capabilities in.
00:09:12.519 --> 00:09:18.309
And we have a whole chunk more on their way in terms of generative UI experiences that kind of create it.
00:09:18.573 --> 00:09:26.534
You know, a very immersive, interactive experience, which unfolds on the fly in response to what you say and what you do and what you see.
00:09:26.693 --> 00:09:26.894
Wow.
00:09:26.894 --> 00:09:27.154
Yeah.
00:09:27.154 --> 00:09:32.974
Something, the things that really stood out to me as well, just talking with Copilot Vision was how personable it really was.
00:09:32.994 --> 00:09:36.323
Like it really did feel like that friend almost.
00:09:36.364 --> 00:09:39.803
And it even gave me like some sass at some points that I said.
00:09:39.803 --> 00:09:42.195
I'm like, Oh, I don't, I don't really like this place.
00:09:42.215 --> 00:09:44.034
And it's like, Oh no, this place is pretty nice.
00:09:44.474 --> 00:09:47.644
Uh, it like kind of laughed at some of my jokes that were not good and it.
00:09:47.924 --> 00:09:53.384
even understood like the tone of my voice when I was like more frustrated or when I was like really excited about something.
00:09:53.384 --> 00:10:09.225
So it really seems like Vision is pushing us in the direction of the AI companion and kind of like that true personal assistant rather than like the traditional chatbot of the original like co pilot or chat QBT.
00:10:09.894 --> 00:10:14.085
Yeah, I'm glad you picked up on that actually because that's actually really interesting.
00:10:14.095 --> 00:10:19.429
You know, what you've described there is It's exactly the line that we're trying to draw.
00:10:19.849 --> 00:10:26.719
So when it occasionally pushes back on you, that's a profound moment because a true friend would do that, right?
00:10:26.719 --> 00:10:32.049
We no one wants like a sycophantic AI that just always mirrors you and always obeys you.
00:10:32.058 --> 00:10:34.659
Like that's not going to be interesting for very long.
00:10:35.288 --> 00:10:38.658
Um, but at the same time, it's got to be kind of respectful.
00:10:39.073 --> 00:10:42.995
Um, it's got to be really aligned to you and on your side looking out for you and stuff.
00:10:43.024 --> 00:10:56.504
And so getting that balance right between when it like shares your energy, um, like if you're really dour and sad and you slow down, you know, the pace of your words and so on, it will bring, you know, an appropriate vibe for that.
00:10:56.504 --> 00:11:07.434
But if you're super fast and excited and super enthusiastic, it will mirror that energy and that back and forth, that chemistry, if you like, uh, is really amplified by.
00:11:07.769 --> 00:11:17.769
Copilot also being able to see what you're currently seeing at that moment and what it is that you're excited about And so, yeah, I think it really creates a very different dynamic in the interactions.
00:11:17.779 --> 00:11:18.549
It's very exciting.
00:11:19.169 --> 00:11:20.240
It is really exciting.
00:11:20.370 --> 00:11:25.169
I think a lot of people are going to try it and be shocked at how good it really is.
00:11:25.169 --> 00:11:28.049
And yeah, like that really stood out to me as well.
00:11:28.529 --> 00:11:29.448
Um, I guess.
00:11:29.679 --> 00:11:36.570
Kind of looking forward 10 years from now, what do you think these personal AI assistants will kind of have in our lives?
00:11:36.590 --> 00:11:45.600
What are some of like the most interesting things you think might happen when we have like this co intelligence living there with us on the web or by our sides with our phones?
00:11:46.698 --> 00:12:04.404
I mean, if you think about how much time we spend on our laptops and phones today, we've created this entire, basically arbitrary, made up, Graphical user interface to accommodate for the fact that computers are too dumb to understand the words that are coming out of my mouth.
00:12:04.955 --> 00:12:05.245
Right?
00:12:05.274 --> 00:12:11.794
The browser, the fact that you have to press a button, the fact that you have all these different apps, you've got menu drop downs, you have scrolling.
00:12:12.164 --> 00:12:30.899
The entire, User interface, what is predicated on the idea that the, to get a computer to do something, you have to be able to write code because it doesn't speak the language that I use to ask you to do something or my friend to do something and that is all going to get washed away.
00:12:31.210 --> 00:12:46.798
Right now, your computer or your AI, your co pilot is clearly going to understand everything that you're bringing to the table, your emotional state, your intellectual state, what you, what you need to get done that day, you know.
00:12:47.169 --> 00:12:53.889
Your interests, your hobbies, your personal knowledge graph, your family, Um, your dislikes.
00:12:54.289 --> 00:13:05.119
So it's not just that it speaks our language, it's actually that it is able to reason over what we see, what we hear, what we believe and think.
00:13:05.509 --> 00:13:15.759
So it's, More than just an interface, it is a new plane of connection, um, that I think is just like fundamentally different.
00:13:15.779 --> 00:13:19.659
And it's going to feel, you know, as I've long said, like a new digital species.
00:13:19.750 --> 00:13:27.914
I mean, it is going to feel like a member of the family, like another, you know, Layer of connectivity because you're going to have an A.
00:13:28.104 --> 00:13:30.245
I'm going to have my I those A.
00:13:30.264 --> 00:13:39.104
I's are going to connect with one another in advance and brief you brief me follow up afterwards, so it's kind of kind of be like a second brain.
00:13:39.235 --> 00:13:50.544
I think of it as like outsourcing a lot of the mental processing, um, to a very reliable, highly accurate, completely interactive.
00:13:50.924 --> 00:14:01.705
Thought partner and companion that, um, is going to help make me much smarter, more productive, feel more supported and so on is very, very different to just using a computer in the way that we do today.
00:14:01.914 --> 00:14:04.054
Yeah, such, such different times.
00:14:04.335 --> 00:14:04.605
Yeah.
00:14:05.313 --> 00:14:14.344
With any sort of powerful AI application, such as Copilot Vision, it needs like kind of copious amounts of data to kind of really be accurate and helpful.
00:14:14.654 --> 00:14:20.264
But of course, with this amount of personal data, there's always a new set of privacy concerns for users.
00:14:20.784 --> 00:14:24.715
How is Microsoft tackling this right now with the launch of Copilot Vision?
00:14:24.715 --> 00:14:27.544
And how do users know that their data is safe?
00:14:27.833 --> 00:14:28.394
Great question.
00:14:28.684 --> 00:14:31.104
So we're keeping a very open mind on this, right?
00:14:31.193 --> 00:14:36.429
I mean, some users will want to keep their ephemeral session.
00:14:36.509 --> 00:14:46.089
So at the moment, co pilot vision, um, throws away the content, the contents of what it has seen at the end of the session.
00:14:46.849 --> 00:14:52.619
Now there's benefits to that from a privacy perspective because it's super straightforward and it's an easy to communicate rule.
00:14:53.399 --> 00:14:54.599
But there's also downsides to it.
00:14:54.599 --> 00:14:57.469
Like we talked about earlier, the benefit of having your A.
00:14:57.469 --> 00:15:02.990
I know you session to session week to week, month to month, I think is going to be pretty significant.
00:15:03.379 --> 00:15:13.019
So we're going to cross that bridge when we come to it, because right now, you know, the models that we have don't actually have good enough memory for us to make that real consideration.
00:15:13.620 --> 00:15:21.039
But if we are to that, it's going to need a new privacy and security infrastructure to be able to store that kind of content because it's going to be very rich.
00:15:21.549 --> 00:15:32.990
Um, it's going to describe in immense detail, not just, you know, moments in time, but strings of activity over, you know, hours and days that are very rich and very high dimensional.
00:15:33.429 --> 00:15:50.344
Um, and personally, I'm pretty optimistic that the value of that, um, information for the user is going to be sufficient, like it's going to be You know, exciting enough, useful enough, interesting enough that, um, some people at least will want to save that.
00:15:50.464 --> 00:15:59.215
And our job will be to create like super secure, private, um, and, and, and safe infrastructure to be able to, um, give people the benefit of those experiences.
00:15:59.524 --> 00:16:04.804
And at the same time, many other people will choose not to save those sessions, and that's also totally fine.
00:16:05.294 --> 00:16:12.114
Um, so that's kind of our approach is that we're going to be taking, um, you know, we're going to be taking the path of giving the user a choice.
00:16:12.590 --> 00:16:22.278
So when exactly is Copilot Vision going to be rolled out to users and, um, when is it going to be rolled out more broadly?
00:16:22.688 --> 00:16:23.828
Yeah, good question.
00:16:23.828 --> 00:16:37.299
So I mean right now it's going to be available in a few days time in Copilot Labs, um, to paying subscribers who will get special access, uh, to trial it and experiment with it, give us feedback.
00:16:37.789 --> 00:16:40.139
I mean this is a very complicated feature.
00:16:40.573 --> 00:16:44.754
Um, has a lot of latency requirements as a lot of inference requirements.
00:16:45.134 --> 00:16:57.375
Um, and so we've been, been very careful on the safety front as well to really be very thoughtful and deliberate, um, in making sure that it works well most of the time, but it's still not perfect.
00:16:57.443 --> 00:16:59.105
And we're just iterating on it.
00:16:59.214 --> 00:17:01.794
Um, you know, steady as she goes kind of thing.
00:17:01.804 --> 00:17:07.954
So, um, sometime next year, uh, in the early part of next year, it will go into GA and lots of people get access to it.
00:17:08.779 --> 00:17:14.828
So Copilot Vision now is already a huge step up from the original Copilot or Bing.
00:17:15.269 --> 00:17:36.099
But another question that I think many people will be wondering is, when will the regular user be able to have the Copilot Vision with fully functioning vision across all their apps, across all their screens 24 7, and no limitations on websites and apps, and possibly even infinite memory?
00:17:36.335 --> 00:17:39.365
Yeah, I mean, that is definitely coming.
00:17:39.454 --> 00:17:41.184
Uh, you know, next year.
00:17:41.275 --> 00:17:45.924
I don't know when next year might be the back end of next year might be the summer might be a bit earlier.
00:17:45.954 --> 00:17:56.503
But, um, you know, we are working extremely hard on getting the cost of inference down so that we can make it widely available to everybody.
00:17:57.105 --> 00:17:59.515
But fundamentally, this is gonna be a cost issue, right?
00:17:59.575 --> 00:18:06.654
Um, because this is an amazing piece of technology that can see what you see and read your screen in real time.
00:18:07.054 --> 00:18:09.884
Um, and obviously that comes with a, with a, with a little bit of a cost.
00:18:09.884 --> 00:18:13.534
So that's going to be the main constraint basically to getting it to GA.
00:18:13.934 --> 00:18:14.535
Yeah, that's great.
00:18:14.535 --> 00:18:25.544
So are there any plans for CoPi to come become kind of agentic and have the ability to kind of take control of your computer and do regular tasks just like a human could?
00:18:25.914 --> 00:18:26.944
Yeah, absolutely.
00:18:26.944 --> 00:18:45.194
I mean, one thing that I'm very excited about is that, um, on Windows, particularly many people sort of struggle with, you know, fixing, um, their system, whether it's doing a software update or might even be as simple as turning on Bluetooth or, you know, turning on Wi Fi or adjusting a setting.
00:18:45.734 --> 00:18:49.914
Um, and the cool thing about Vision is that Copilot can now.
00:18:50.460 --> 00:18:52.230
See what you're doing on your screen.
00:18:52.289 --> 00:19:01.609
And when you pop up a, you know, a screen just as you would, if you called a, you know, technical support system, it can actually guide you through that, um, step by step.
00:19:01.609 --> 00:19:03.380
And it's a magical experience.
00:19:03.380 --> 00:19:10.220
I mean, we have over a billion daily active users on Windows and, you know, not all of them are as technical as your audience.
00:19:10.519 --> 00:19:17.390
And so, you know, um, I think it's gonna be pretty cool to have people get the opportunity to just ask copilot.
00:19:17.734 --> 00:19:20.804
In natural language, you know, where do I click?
00:19:20.814 --> 00:19:21.934
What does that menu say?
00:19:21.964 --> 00:19:23.044
Where do I go from there?
00:19:23.115 --> 00:19:34.574
Um, so that's just one example of increasingly agentic like behaviors, but we're also very interested and working hard on how it navigates the browser, fills in forms, calls APIs, etc.
00:19:34.594 --> 00:19:36.864
So a big priority for us at the moment.
00:19:37.144 --> 00:19:47.875
So something I'm really excited for personally is when AI can not only see my screen in real time with something like vision, but also guide me through learning.
00:19:48.609 --> 00:19:54.439
To use new apps by controlling my screen and showing me exactly where I need to go.
00:19:54.710 --> 00:20:02.250
For example, if I'm learning how to use Photoshop, I can have a vision, kind of see my screen in real time and guide me through certain tasks and tell me how to do it.
00:20:02.480 --> 00:20:15.759
But imagine if the AI can actually take control of my screen and show me, this is the tool you want to use to, you know, mask a character, or this is the tool you want to do to, uh, clip out that character and kind of have that.
00:20:16.138 --> 00:20:19.720
AI guide me through that end point.
00:20:19.869 --> 00:20:25.039
I think the AI assistant or co pilot for education is going to be absolutely massive.
00:20:25.640 --> 00:20:32.140
Are there any other use cases that get you really excited with these full on vision and agentic co pilots?
00:20:32.709 --> 00:20:46.699
Yeah, I mean, the future of co pilot vision is definitely co pilot help, step by step, taking you through, um, troubleshooting when you're trying to fix your computer or you're trying to learn a new piece of software like, like Photoshop, like you said.
00:20:47.249 --> 00:20:56.609
Um, that's, that's for sure coming and I think it will really help people, um, who might be like less capable of using their computer as well.
00:20:56.835 --> 00:20:57.894
Debugging their issues.
00:20:57.894 --> 00:20:59.474
I think that's going to be very liberating.
00:20:59.974 --> 00:21:03.884
Um, but it's also going to help you with basic tasks in the background.
00:21:03.894 --> 00:21:09.375
Like, um, you know, going shopping, for example, I mean, it will populate your basket in advance.
00:21:09.384 --> 00:21:16.184
It will ask you if you want this or that, or it will find a bunch of prices and be like, You know, there's a better opportunity.
00:21:16.184 --> 00:21:16.914
You could get it here.
00:21:16.914 --> 00:21:18.984
And typically, you might not be bothered to do that, right?
00:21:18.984 --> 00:21:26.694
Because you're like, Oh, can I really be bothered to buy, you know, buy my groceries from three different stores to get the optimal price?
00:21:26.794 --> 00:21:30.054
No, like you probably just going to get them all from one place.
00:21:30.054 --> 00:21:40.634
And so, you know, now you're just going to have copilot in the background, go off and, uh, Find you all those different options aggregate them for you and then go and execute the purchases in all the different environments.
00:21:40.644 --> 00:21:44.234
So, you know, there's just so many possibilities is kind of limitless.
00:21:44.255 --> 00:21:48.403
Um, one of the things that I've been really excited about is the role in gaming as well.
00:21:48.513 --> 00:21:59.525
Um, you know, you can imagine having your copilot companion, um, talk to you about the worlds that you're building in Minecraft or, um, hang out with you and call a duty.
00:21:59.835 --> 00:22:04.315
You know, it's probably going to feel like an ever present.
00:22:04.730 --> 00:22:21.220
Companion in whatever setting you're in, whether it's the browser, whether it's your slack app, whether it's, you know, um, you know, your gaming environment, because naturally you're going to be like, well, It's my co pilot, like I, of course, I wanted to be here and be like, Hey, co pilot, did you see that?
00:22:21.710 --> 00:22:23.069
Um, you know, what should I do next?
00:22:23.069 --> 00:22:27.990
Like, you know, that, that kind of ever present thing is, is definitely where we're headed.
00:22:27.990 --> 00:22:31.569
And so we'll just see it show up in a lot of different settings, I think.
00:22:32.019 --> 00:22:35.028
Yeah, we're headed into a completely new era.
00:22:35.179 --> 00:22:44.088
And I guess my next question is, how is Microsoft thinking about educating the next generation of students and businesses and builders on using AI as a co pilot?
00:22:44.279 --> 00:22:47.388
Co intelligence rather than a full on replacement.
00:22:47.789 --> 00:22:52.888
Yeah, I mean, that is the beauty of how we've framed, I think, co pilot.
00:22:52.939 --> 00:23:01.749
Like, it is explicitly designed to be in the background, to be an aide, you know, to be a conciliary.
00:23:03.119 --> 00:23:06.089
Giving you great advice, giving you support, giving you feedback.
00:23:06.089 --> 00:23:09.628
It's, it's, it's explicitly in service of you.
00:23:10.190 --> 00:23:23.740
Um, and we've sort of tried to frame the aesthetic of the UI like that, the tone of the conversation, you know, the way that we've deployed, um, voice is, is very much in tune with that and the way we think about vision too.
00:23:23.740 --> 00:23:32.890
So as it progresses, we'll keep that same, um, you know, approach and set principles, which is like, this is something that you control.
00:23:33.130 --> 00:23:37.640
That you're in charge of, that is aligned to your interests, that is on your team, that is backing you up.
00:23:38.019 --> 00:23:39.440
It's like your little hype man.
00:23:39.630 --> 00:23:50.099
And I think that's an important distinction to, um, you know, my friends and the people that I love from the last 15 years of being in the field.
00:23:50.140 --> 00:23:57.359
That where there's a bit more of a focus on AGI and super intelligence and this kind of inevitable explosion of something that's more powerful than us.
00:23:57.369 --> 00:24:01.210
I mean, that's just not what we're building and what we, what we want to build.
00:24:01.210 --> 00:24:01.490
And.
00:24:03.105 --> 00:24:04.964
It's really a very different kind of experience.
00:24:04.964 --> 00:24:06.224
It's a personal companion.
00:24:06.255 --> 00:24:07.204
It's for you.
00:24:07.275 --> 00:24:10.615
It's not for the brand or the business or the company.
00:24:10.933 --> 00:24:17.124
There will be other AIs that do that, but everyone is going to have their own AI that represents them, that's on their team.
00:24:17.154 --> 00:25:07.835
And that's kind of dramatic departure from You know, the previous world of social media, right, where you have to rely on your eyeballs as a human to make sense of that feed, you know, wherever you're on Twitter or Instagram or, you know, you're using a computer, whereas now you have this other interface layer that is is kind of almost adversarially Interacting with the content that is being shown at you is your filter, you know, and I think that's a big paradigm shift because it's like putting the most powerful technologies, um, you know, in your hands on your side so that you can so that it can so that you can teach it the kinds of things that you want the preferences that you have rather than just be at the mercy of the preferences and attitudes of values of the feeds that you're being shown by any one of those companies.
00:25:07.845 --> 00:25:09.474
So that's a big shift in that sense.
00:25:09.849 --> 00:25:16.148
And my last question here, I know you're super busy, but do you have any advice for future generations of students and businesses?
00:25:16.929 --> 00:25:26.009
My advice is always like think of yourself as an accelerationist, you know, adopt, embrace, absorb, do so critically.
00:25:26.839 --> 00:25:30.789
And those things aren't intention, you know, they're not intention with one another.
00:25:31.009 --> 00:25:34.960
You can still be as optimistic and excited as I am about the future of technology.
00:25:35.724 --> 00:25:42.605
Whilst at the same time being critical, wide eyed, trying to establish boundaries, say what you do or don't like.
00:25:42.875 --> 00:25:43.615
That's the game.
00:25:43.625 --> 00:25:45.224
There's no kind of rejection of it.
00:25:45.305 --> 00:25:58.894
And there's no, you know, sort of complete, you know, on unbridled, uh, you know, investment in it, uh, to just, just kind of have its own life or something and just be, have its own organic form and do its own thing.
00:25:59.365 --> 00:26:01.184
There is a middle path where you can be.
00:26:02.200 --> 00:26:03.990
You can sit in between those two things.
00:26:03.990 --> 00:26:05.569
And I think that's the right way to think about it.
00:26:05.940 --> 00:26:07.529
All right, well, that's it for the interview.
00:26:07.549 --> 00:26:11.130
Thanks so much for taking the time and good luck with the launch.
00:26:11.450 --> 00:26:12.019
Thank you, man.
00:26:12.019 --> 00:26:14.548
This has been a lot of fun and really appreciate you.
00:26:14.548 --> 00:26:15.380
So thanks for doing this.