TRANSKRIBEERI 🔗
WEBVTT
00:00:10.960 --> 00:00:21.760
Today I'm joined by David Windt, a founder and an operator who has built scale and sold companies and is now building again at the frontier of AI with his new venture, Agent Work.
00:00:22.239 --> 00:00:33.840
David previously founded PeerGrid and EdgyFlow, taking them through Y Combinator, growing them largely through product-led growth and word of mouth, and ultimately acting to Multiverse.
00:00:34.240 --> 00:00:45.119
Along the way, he's had a front row seat to what it really takes to scale a product, a team, and an organization, both inside a venture backpath and outside of it.
00:00:45.359 --> 00:00:49.200
In this conversation, we are going to talk about three big things.
00:00:49.359 --> 00:00:55.600
First, how to design a product that effectively scale themselves through reforms and self-serve.
00:00:56.000 --> 00:01:00.159
And David, I'm hearing that there's an interesting story about the Romanian church.
00:01:00.240 --> 00:01:02.000
So I would love to hear more about it.
00:01:02.320 --> 00:01:10.239
Second, what David has learned about sustainable scale and why he deliberately chose not to chase headcomb heavy hypergrowth.
00:01:10.480 --> 00:01:24.400
And third, how he's thinking about scaling with AI agents at agent work, what a digital workforce actually looks like in practice, and when founders should use agents instead of hiring more people.
00:01:24.799 --> 00:01:34.879
If you're building or scaling a company and you care about efficient growth, clear unit economics, and pragmatic ways to use AI in your operation, this episode is for you.
00:01:35.200 --> 00:01:36.640
Welcome, welcome, David.
00:01:37.120 --> 00:01:38.000
Thank you.
00:01:39.359 --> 00:01:50.000
So as you as you heard from the intro, the premise really is for us to get to know you, how you've scaled the previous two companies, and kind of like what are you doing differently this time around?
00:01:50.239 --> 00:01:57.280
So help us shape the thinking in terms of how you're building now versus how you were building five or ten years ago.
00:01:58.079 --> 00:01:59.200
It's a good question.
00:01:59.439 --> 00:02:02.079
I think in many ways, in the same way.
00:02:02.239 --> 00:02:10.800
Like we're trying to not change most of how we used to do things because I think we had a company that was running quite well in Noe.
00:02:11.039 --> 00:02:21.840
I think there's obviously some different things happening in the world right now with AI, and that impacts specifically like how we think about hiring and how we think about building.
00:02:22.000 --> 00:02:41.199
So the big difference, obviously, that most people have already observed is that what used to take us three months for a full-time engineer to build, you can fundamentally like build in an afternoon as a founder, which means that you can you don't need to hire a bunch of engineers first and foremost.
00:02:41.280 --> 00:02:42.719
You can you can get a lot done.
00:02:42.879
Load full transcript
--> 00:02:45.599
And like engineering is not the bottleneck anymore.
00:02:45.919 --> 00:02:49.280
But it also means you can you can test things much faster.
00:02:49.360 --> 00:02:58.400
If you have a good idea, or at least you think it's a good idea, you can build it in an hour or two hours, and then you can put it in production and you can see if it actually works.
00:02:58.560 --> 00:03:00.960
And if it doesn't work, you can just delete it again.
00:03:01.280 --> 00:03:08.479
So it's much cheaper to make mistakes, which means if you can move fast, you can iterate extremely rapidly.
00:03:08.800 --> 00:03:14.159
But if you can't, then it's you're kind of at a disadvantage compared to your competitors who might be able to do that.
00:03:14.319 --> 00:03:22.800
So practically we hire fewer people, and on the other side, like we can ship product much faster than we used to, even with a much smaller team.
00:03:23.280 --> 00:03:30.560
So, besides uh writing code and building faster, what like what are your hacks?
00:03:30.639 --> 00:03:34.719
Kind of how are you doing things differently now than you were doing before?
00:03:34.879 --> 00:03:37.439
How do you get in front of customers?
00:03:37.680 --> 00:03:43.120
Um, like what other accelerants have you found that that work?
00:03:44.080 --> 00:03:44.879
It's a good question.
00:03:44.960 --> 00:03:47.840
And I actually think in some way that's becoming harder.
00:03:48.000 --> 00:03:54.960
Um, not because the modern AI stack for go-to-market and marketing and so on isn't getting better as well.
00:03:55.280 --> 00:04:05.919
But given that writing product isn't the bottleneck for most teams anymore, uh, there's a lot more products out there, all like going for the same attention of the same people.
00:04:06.159 --> 00:04:11.759
So like breaking through the attention span of a customer is actually getting more complicated.
00:04:12.080 --> 00:04:25.279
Anybody can like sign up for an automatic uh email, cold email sender in five minutes and then click a button and send a thousand cold emails to everybody, which means everybody's getting a lot more personalized emails.
00:04:25.439 --> 00:04:30.800
And when everybody's getting a hundred personalized emails, then they don't read any of them anymore.
00:04:31.120 --> 00:04:48.879
So I think there's like we're trying to do some of the same things that everybody else is doing, and are kind of obvious that, like, okay, we need to use all the modern tooling here, but but in the end, I think it's actually going to be much harder to get distribution for your products now that that everybody has all these AI tools.
00:04:49.680 --> 00:04:56.399
And so does this mean then we're going to see um a shift from digital to analog?
00:04:56.560 --> 00:05:16.959
Uh, are you seeing more like a transition back to kind of like I guess what what used to work in the past with uh like events and active labs and activations, like things that they're just kind of going back
to like would we see a continuous rise in the third spaces where people are just congregating together?
00:05:17.360 --> 00:05:37.519
Yeah, yeah, I think we will see more physical things happening, and I think another thing that will probably become even more extreme now is that if you already have a following, if you're an influencer on some social media, that will be even more powerful because that is basically the biggest hack you can have right now is to have the customer list available right now.
00:05:37.759 --> 00:05:46.800
So I think the people who manage to grow an audience before or can figure out a way to do it now will have a big advantage when when anybody can build a product, right?
00:05:46.879 --> 00:05:55.120
You can just if you have the audience, you can just bycode an alternative product and sell it to your audience, which you've seen people do that in the past, right?
00:05:55.199 --> 00:05:55.600
Like Mr.
00:05:55.680 --> 00:05:58.079
Beast launching a burger chain or something, right?
00:05:58.160 --> 00:06:08.079
Like it doesn't make any sense, but if you have the audience, you can just uh like whip up any product, label it with you, and like ship it to your customers.
00:06:08.160 --> 00:06:13.120
And I think that's we're probably gonna see that entering more into the startup world as well.
00:06:13.279 --> 00:06:19.680
Like uh vibe code and alternative to obsessed product and then send it to your audience at a subscription price.
00:06:20.079 --> 00:06:27.759
So I mean our audience are scalar founders, that's who we write for, this this is who we serve.
00:06:28.000 --> 00:06:32.720
So if they're hearing this for the first time, and if they're not Jimmy um or Mr.
00:06:32.800 --> 00:06:37.759
Beast, how do they how do they go about building an audience?
00:06:38.000 --> 00:06:52.959
Because you know, there's this different growth strategy from product led growth to sales that grow to community led growth, um, and and obviously communities emerged to be the most powerful, but that's predicated upon you already having a community.
00:06:53.120 --> 00:06:57.920
So if you are in the early uh stages, how do you build a community?
00:06:58.720 --> 00:07:03.040
I think that's probably like I'm not the right person to ask because I'm not very good at it.
00:07:03.199 --> 00:07:06.480
I think it's been one of those things where I've always wished.
00:07:06.879 --> 00:07:08.079
I think like so, okay.
00:07:08.160 --> 00:07:10.879
I think I've always wished that like I wish I had a community.
00:07:10.959 --> 00:07:15.839
I wish I had a big uh following on X, but I think it's like very classical.
00:07:16.000 --> 00:07:20.959
I would like to be the person who has it, but I'm not actually the right person to build it, right?
00:07:21.040 --> 00:07:26.240
I'm not super excited about sitting and writing like thought leadership content on X or something.
00:07:26.319 --> 00:07:29.680
It doesn't like it's not what I wake up to do in the
morning.
00:07:29.759 --> 00:07:32.959
I like doing other things, and I think it's super hard.
00:07:33.120 --> 00:07:36.079
It's equally hard to building another type of business.
00:07:36.399 --> 00:07:40.480
It's an art form, it's stand-up comedy on social media, right?
00:07:40.560 --> 00:07:42.079
It's it's tough.
00:07:42.319 --> 00:07:56.319
So I don't think I think the problem is with a thing like that, you can obviously like you don't have to be the world's best or the world's largest audience to have any value from this, but but it's like with many other things, if you do it half-assed, it doesn't give you any value.
00:07:56.480 --> 00:07:58.800
And if you do it really well, you get a ton of value.
00:07:58.879 --> 00:08:04.720
So there's some like power law going on here where somebody will say, like, oh, we should I should have an audience.
00:08:04.800 --> 00:08:11.199
They're gonna write a LinkedIn post uh a few times a week for three weeks, and then they're gonna give up because nobody cared.
00:08:11.279 --> 00:08:13.199
Yeah, and like it's it's not enough, right?
00:08:13.279 --> 00:08:18.000
You can't just click a button and get an audience, you have to do all the hard work.
00:08:18.079 --> 00:08:22.639
So I think it's for sure for most people, it's kind of like an either or like if you do it, do it well.
00:08:22.800 --> 00:08:25.920
If you if you don't do it well, then don't do it at all, probably.
00:08:26.480 --> 00:08:34.879
Well, and and uh it it like it's it's like everything in life, it takes time to master.
00:08:35.360 --> 00:08:44.240
And uh the other thing is that you have to be authentic to yourself because a lot of people go down, like I mean, there's a saying, what enrages, it engages, right?
00:08:44.399 --> 00:09:02.480
So a lot of people go down the clickbaity routes like being very provocative or uh uh controversial, and that's great for the moment, but but then it begs the question well, who are you as an influencer or as a scalar founder, whatever it might be.
00:09:02.720 --> 00:09:13.440
Uh but I read something or heard a podcast a long time ago that inspired me a bit, which was like it's not actually that hard, surprisingly, to make the world's best resource on something.
00:09:13.600 --> 00:09:14.159
Okay, right?
00:09:14.240 --> 00:09:20.320
It's like it can't be like the world's best book on negotiation, like that's a very big topic.
00:09:20.399 --> 00:09:22.080
Like a lot of people have worked on that before.
00:09:22.240 --> 00:09:41.600
But if you're like, no, but but I work in let's say car sales or whatever, then it's like I'll write the best thing about specifically selling electric cars or whatever, like you knees down enough so that there's not a ton of competition, and then write an incredibly good thing, or build a good thing, or make a good thing.
00:09:41.840 --> 00:09:47.679
It has to be the best in the world, yes, but if you knees it down enough, it's not actually that complicated.
00:09:47.759 --> 00:09:55.919
And you see a lot of technical blog posts where like some engineer somewhere is writing this like very detailed blog post about this very niche technical subject.
00:09:56.240 --> 00:09:58.799
Maybe a hundred people read it, maybe a thousand people read it.
00:09:59.279 --> 00:10:13.519
But for them, that is like the the best thing in the world, and I think that's it's actually easier to make the best in the world type of content on a niche subject than trying to be like LinkedIn here and a little bit of X there and so on.
00:10:13.600 --> 00:10:16.639
Like it doesn't nobody cares if it's not the best.
00:10:16.720 --> 00:10:24.559
So I think that'd be my recommendation like find something that's small enough that you can write the best thing in the world, yeah, and then spend the time it takes to make that thing.
00:10:24.879 --> 00:10:25.360
For sure.
00:10:25.440 --> 00:10:32.080
I couldn't agree more um with my with my digital and content team in Buenos Aires.
00:10:32.320 --> 00:10:34.559
We that's one of our core focus.
00:10:34.720 --> 00:10:38.480
We we want to produce content that uh Scala Founders found useful.
00:10:38.639 --> 00:10:48.879
And so we one of the articles or in-depth guides that we published was on forward-deployed engineering model, and so the FDE model got popularized by Palantir.
00:10:49.039 --> 00:10:55.039
And so if you look at the content that we write, it typically ranks in top three.
00:10:55.200 --> 00:11:00.000
Um, and and to be honest, it takes a lot of time to research.
00:11:00.159 --> 00:11:05.440
Like writing a content piece easily takes us eight plus hours.
00:11:05.600 --> 00:11:10.320
Um, because it's not just putting a prompt and it's coming out with whatever comes out.
00:11:10.559 --> 00:11:16.559
Um we go through a citation, we go through references, we go through competing articles, see what's there.
00:11:16.720 --> 00:11:24.240
And and then once you have developed the article, this is kind of just the first gate, just the first milestone.
00:11:24.480 --> 00:11:31.039
Then we have uh a mechanism in place where continuously monitoring the competing articles to see if they update them.
00:11:31.200 --> 00:11:39.600
And the algorithm, both on um the LLM models and in the search models, are such that it rewards the recency, right?
00:11:39.679 --> 00:11:54.960
So we're constantly trying to update content with the most relevant information in order to stay in the top three, because essentially, what it's AI citation or Google mentions or whatever it is, it's it only rewards the the top the top five.
00:11:55.120 --> 00:11:58.799
If you're below top five, you really don't get in any traffic.
00:11:59.120 --> 00:12:06.080
Yeah, and I think like the other hack to doing that is like have data or have something that other people don't have, right?
00:12:06.320 --> 00:12:11.279
It's very hard to write a post that's very good about something that is not uniquely yours.
00:12:11.600 --> 00:12:12.080
Yours, yeah.
00:12:12.240 --> 00:12:17.360
So what we did for our old company, EGFlow and Peer Grid, was that we used our data, right?
00:12:17.440 --> 00:12:27.360
So we had a ton of data from our users using the product in interesting ways, and we would like anonymize it in the right way, and then we would produce like basically research.
00:12:27.519 --> 00:12:37.200
Like this is like something that nobody else can answer, but we can, because we have access to some secret data, and that allows us to make very interesting content that is uniquely ours.
00:12:37.759 --> 00:12:39.840
So let me ask you a question then, David.
00:12:39.919 --> 00:12:42.159
Um, because I want to riff on that point.
00:12:45.200 --> 00:12:48.960
You said it's super easy to vibe code, it's it's super easy to build.
00:12:49.039 --> 00:12:51.759
Um, get in front of the audience becoming harder.
00:12:51.919 --> 00:12:59.039
Um the speed and velocity has uh increased exponentially since you built your first company.
00:12:59.440 --> 00:13:03.440
How does a scalar founder think about creating a mode?
00:13:03.519 --> 00:13:09.360
Um, so that it's it's something that gives them an enduring, lasting competitive advantage.
00:13:10.320 --> 00:13:11.679
It's it's a good question.
00:13:11.840 --> 00:13:17.279
And I think there's probably many modes to build that they're all classical.
00:13:17.440 --> 00:13:22.159
I think the number of features is the one that has disappeared the fastest, right?
00:13:22.240 --> 00:13:34.080
Like in the old days, it would be kind of hard to build a new learning management system, which is what we did at Eduflow, because there's just like a hundred table stakes features like SCORM support and single sign-on and quizzes and so on.
00:13:34.159 --> 00:13:35.679
You have to build a hundred things.
00:13:35.919 --> 00:13:39.279
You could do that in a month now, so that's not the problem anymore.
00:13:39.360 --> 00:13:46.720
So then you have the other types of modes, which is like you have a lot of customers, they're like integrated already, they don't want to churn.
00:13:47.039 --> 00:13:52.720
You have a good brand, you have data that you can use for some advantage, different types of network effects.
00:13:52.960 --> 00:13:59.039
I think all of the other modes are classical and they are probably still around.
00:13:59.279 --> 00:14:07.200
I think a lot of people will think about data as a mode, and I think it is a strong mode if you can really make it useful.
00:14:07.440 --> 00:14:23.279
But I think for most people it's quite hard because the models, for example, if you think about AI models today, they're growing so fast, they're becoming better so fast that even the data gets outdated in a way, and like all the data you thought was very valuable turns out to be not that interesting in the next iteration.
00:14:23.440 --> 00:14:26.399
So I don't know, like that's an open question for me.
00:14:26.639 --> 00:14:35.120
But you can see products like Lovable, for example, and there's like a bunch of competitors, uh Replit and V0, and so on.
00:14:35.200 --> 00:14:37.120
And they're all kind of similar products, right?
00:14:37.200 --> 00:14:41.840
And like one of their biggest advantages for, for example, Lovable is that they have an incredibly strong brand.
00:14:42.159 --> 00:14:43.919
People know about it and they want to use it.
00:14:44.000 --> 00:14:54.879
The same with Chat GPT, like in many ways, Cloud is probably better for many things, but ChatGPT was the thing that everybody used in the beginning, and it's like become synonymous with AI now.
00:14:55.679 --> 00:15:01.519
Um so having a brand, being out there, like talking about it is it's a huge benefit.
00:15:01.759 --> 00:15:12.559
And if everybody, if every product converges to the same thing, then you're just gonna stick with the one you know, the one your friends are using, like people are gonna be simple about it.
00:15:13.200 --> 00:15:22.799
So um a lot of our clients are asking a question, what will happen to software?
00:15:22.879 --> 00:15:27.600
And I'll give you kind of context because it it triggered me with the with the previous point.
00:15:28.559 --> 00:15:38.720
We we're launching the future ventures academy, and in our search for the future ventures academy, which is the course curriculum, the active lab, the activations, um, we went down the traditional path.
00:15:38.799 --> 00:15:40.559
Let's let's explore learning management systems.
00:15:40.720 --> 00:15:47.200
So we went to like looking at BetterMode and Micro Networks and Hybrid and blah, blah, blah, blah, blah, a whole bunch of lists.
00:15:47.279 --> 00:15:49.759
And so, and then we went down the open source route.
00:15:49.919 --> 00:15:53.039
And I think we've settled down on an open source system for a moment.
00:15:53.200 --> 00:16:06.639
Um but if you can build an LMS within a month, then what's the value proposition for a SaaS company?
00:16:06.879 --> 00:16:19.840
Do you believe that the SaaS market will go through a bit of disturbance and only the biggest, most entrenched, the companies with a high switching cost will continue to drive?
00:16:19.919 --> 00:16:21.039
Kind of like what's your perspective?
00:16:21.200 --> 00:16:30.639
And if you can break it down into like large or complex software, like SAP, mid-grade, and kind of like more entry-level niche product.
00:16:31.360 --> 00:16:36.320
I think it's probably gonna be a slow but then like sudden transition in a way.
00:16:36.480 --> 00:16:47.279
Like, if you think about simple products in a way, like DocuSign is everybody's favorite example of a company that has a very simple core product and they have like 5,000 people or something.
00:16:47.360 --> 00:16:55.360
Yeah, um, it's not like yes, people can vibe code a docusign tomorrow, but that doesn't mean docculies is going to zero tomorrow, right?
00:16:55.440 --> 00:16:59.600
It's gonna take a
long time because people are like integrated into this product and so on.
00:16:59.759 --> 00:17:04.720
And it's not like people are gonna wake up tomorrow and say, I'm gonna vibe code my own doc design for for a big company.
00:17:05.279 --> 00:17:06.720
But what's happening?
00:17:06.960 --> 00:17:08.480
So it's kind of like I don't know.
00:17:08.559 --> 00:17:11.200
I I'm assuming that's in there, Mark, you guys don't have Costco.
00:17:11.599 --> 00:17:23.440
But what the one of the examples here is that it's a big warehouse, uh yeah, and and so some of the examples that's being given is like or or or maybe Amazon is more accurate than Costco.
00:17:23.680 --> 00:17:30.880
If a product becomes really successful, they they build out the name, the no-name brand, or they build like the Amazon version of a product.
00:17:31.119 --> 00:17:43.519
And so I but because we deal with a ton of founders, we um about a month or so ago, we got a document, an NDA to sign, and it came out of a Google Docs.
00:17:43.680 --> 00:17:50.240
So now we see the super mega cap the companies rolling out features that previously were companies like Docker.
00:17:50.960 --> 00:17:54.880
So now we're signing documents via Google Docs rather than DocuStyle.
00:17:55.200 --> 00:18:02.480
So do you because of the speed with which things can be developed, do you now think that some of those niche companies are going to disappear?
00:18:02.799 --> 00:18:05.119
I think it's gonna be incredibly fragmented.
00:18:05.279 --> 00:18:07.839
I think like every company will do everything.
00:18:08.000 --> 00:18:10.559
I think is kind of what I'm seeing as a trend right now.
00:18:10.720 --> 00:18:14.799
I saw like I love the lovable product, I've been following it for a long time.
00:18:14.960 --> 00:18:20.559
And then I saw this morning, I think, that lovable is now releasing a new version that can do anything.
00:18:20.640 --> 00:18:23.519
So it's not just building websites, now it's like an everything agent.
00:18:23.920 --> 00:18:24.960
Like every other company.
00:18:25.039 --> 00:18:28.720
Like there's no company right now in tech that's not building an everything agent.
00:18:28.880 --> 00:18:33.759
Like they're all building some variation of Claude Cowork or OpenClaw, whatever.
00:18:33.920 --> 00:18:37.680
Every single company, Airtable, used to be a beautiful table product.
00:18:37.759 --> 00:18:39.279
Now it's an Airtable agent thing.
00:18:39.359 --> 00:18:41.039
You can't even make a table anymore.
00:18:41.200 --> 00:18:47.920
And like it's like every single company is converging to the same product, trying to be everything for everybody.
00:18:48.160 --> 00:19:15.039
And I think that's really weird, and I don't know how it's gonna work, but I think you'll see you'll probably see dynamics like um Microsoft acquiring Slack and so on, where like if you have a really strong enterprise footprint and you have the customer base already and you have the data processor agreements, you have a big advantage because you can just now ship so many products and features into your product ecosystem.
00:19:15.200 --> 00:19:18.079
You already have the customers, you just upsell them on new things.
00:19:18.640 --> 00:19:25.279
So, on one hand, anybody could build a docusign, but because everybody can build a docusign, it's gonna be a thousand docusigns.
00:19:25.440 --> 00:19:30.960
And the one you're actually gonna use now that they're all kind of comparable is the one that's already in the stack you use.
00:19:31.200 --> 00:19:42.799
So I think actually this is gonna help some of the incumbents quite a lot because they can now just expand their product repository to like anything goes, like Google adding docusign features, right?
00:19:42.880 --> 00:19:45.839
Yeah, so it's chaos, it's complete chaos.
00:19:45.920 --> 00:19:49.200
I don't know what's gonna happen, but it's definitely weird.
00:19:50.640 --> 00:19:56.880
So can we now transition a bit and talk about agent work, uh, your your new company?
00:19:57.039 --> 00:20:06.319
Um, because we're seeing the same thing, we're seeing everyone uh and anybody trying to roll out some kind of an agentic uh platform.
00:20:06.559 --> 00:20:12.960
What is Salesforce, what is like Hotspot, what is like you can build your own agents?
00:20:13.119 --> 00:20:16.480
So tell me how you were thinking about agent work.
00:20:17.119 --> 00:20:20.160
Yeah, in a way, it's kind of like I'm I'm doing a dumb thing, right?
00:20:20.240 --> 00:20:25.119
I'm also building an agent product, and I've just been saying that like everybody and their mom is building an agent product.
00:20:25.200 --> 00:20:26.799
So that seems kind of ridiculous.
00:20:27.039 --> 00:20:29.920
I think our approach is a little bit different.
00:20:30.079 --> 00:20:35.359
So, like the core idea behind agent work is that it's a product that has an agent inside it.
00:20:35.440 --> 00:20:53.759
You can give it a task like you would give to Claude Cowork, but then what we try to do differently is that as soon as the agent kind of hits a block or is thinks it's done, but it's not necessarily correct, there's a human in the loop that checks everything and ensures that the output is correct, and that the agent will actually finish.
00:20:53.920 --> 00:20:56.960
So just think about it as like a David.
00:20:57.359 --> 00:21:01.359
Um, who is the ideal customer profile for agent work?
00:21:01.519 --> 00:21:09.759
Kind of like I'm assuming it's somebody that maybe has some technical predilection, but it's not necessarily um super knowledgeable.
00:21:09.920 --> 00:21:16.400
Just hopefully it's not um it's not an engineer, it's not somebody who gets excited about running their own open claw or something.
00:21:16.720 --> 00:21:38.400
So agent work is for people that are like non-in-engineering roles, so that could be like sales, marketing, legal recruiting, ops, like people in companies who have different types of computer
problems, not like my computer isn't working, but like problems you would solve with a computer, like making slide decks, generating reports, doing research.
00:21:38.559 --> 00:21:42.240
Um they have a problem that's big and complicated.
00:21:42.559 --> 00:21:47.839
They could, in theory, hire a person to do it, but that's too complicated and costly.
00:21:48.000 --> 00:21:50.079
But Chat GPT can't solve this problem.
00:21:50.240 --> 00:21:52.319
This is like too big or too important.
00:21:52.640 --> 00:22:08.640
Um so this is a way to like give that problem to a to somebody and get it solved, and then what 18 World does is like it Use AI as much as it can, but there is a human in the loop who ensures that everything is going to be good enough when you get it back, and you're not going to have to manage an agent now.
00:22:08.720 --> 00:22:10.319
You're you're getting a result back.
00:22:10.480 --> 00:22:11.759
That's kind of our approach.
00:22:12.000 --> 00:22:18.559
And so, David, where does agent work excel in structured tasks?
00:22:18.960 --> 00:22:22.160
Like, for example, like you in cloud, you can build a skill, right?
00:22:22.240 --> 00:22:25.839
Like, um, or in an unstructured task, kind of like the one-off.
00:22:26.079 --> 00:22:31.119
Like, where where would it excel vis-a-vis uh another product or a platform?
00:22:31.519 --> 00:22:38.000
So I think like where we've started and where we excel today is things that relate to like finding information online.
00:22:38.160 --> 00:22:44.079
So that could be generally research problems, but it's specifically like lead generation, web scraping, and so on.
00:22:44.240 --> 00:22:54.880
Um, and that could be like one of the reasons we can take an excel at that is that a lot of the data you often need is behind like gated gated services, LinkedIn profiles or stuff like that.
00:22:55.119 --> 00:23:04.160
It's also like sometimes these like very vague problems where I need a bunch of things that like live up to some criteria, but you don't know how many there are.
00:23:04.319 --> 00:23:09.680
It's kind of you need to find them on weird sources, you have to judge a lot.
00:23:09.759 --> 00:23:12.960
Like, so we have a lot of people using it for lead generation of different sorts.
00:23:13.119 --> 00:23:21.759
Like, give me like founders who exited at least two years ago and are now working on something new, but they haven't raised capital for it yet.
00:23:22.160 --> 00:23:25.759
Stuff like that, which is like hmm, that's like a hard query to make.
00:23:26.000 --> 00:23:28.799
So you have to like make a good plan and execute it and so on.
00:23:29.119 --> 00:23:31.680
So let me give you a real scenario.
00:23:32.319 --> 00:23:40.799
Um, about a month or so ago, um we decided to start building our own uh platform, the capital intelligence platform.
00:23:40.960 --> 00:23:59.119
And and and the reason why we did so is we raised money on behalf of companies, and uh um have like there are products, there are a ton of products that do this, that that would give you uh uh like an investor database, but that that wasn't our primary motivation.
00:23:59.279 --> 00:24:03.599
Uh our primary motivation was speed, quality, efficiency, and precision.
00:24:03.759 --> 00:24:13.680
And so we started to build our product, and so we we had to go through laborious effort to build out, of course, we started with our theorem, to build our database.
00:24:13.759 --> 00:24:21.759
We have 17,000 investment firms at the moment, being private equity venture capital firms, uh family offices, uh, angels, and so on.
00:24:21.920 --> 00:24:32.559
Now, can I use agent work to continuously enrich the data where one of our 64 fields is blank and not populate at the moment?
00:24:32.640 --> 00:24:47.200
Because essentially, what we're trying to do is in the algorithm, we have we have we have done simple matching, like a company A, this is the this is the like this is who they are in terms of context, background, geography, check size, they look, and then we're trying to match the investor.
00:24:47.359 --> 00:24:53.599
So, how can I use agent work to populate, continuously populate this uh this database?
00:24:53.920 --> 00:24:58.400
Yeah, so agent work can actually be used in in two, maybe three ways, but at least like two ways.
00:24:58.559 --> 00:25:00.880
One is as a human, looks like any other product.
00:25:01.039 --> 00:25:04.160
You log in, there's a chat, you talk to the agent, you give it a task.
00:25:04.319 --> 00:25:14.079
I think that would be more useful for the first step of like, hey, I need a list of a database from scratch, and then you can use agent work as an API or or through an MCP server.
00:25:14.400 --> 00:25:32.720
So you could have basically an automation that says whenever we have an empty field in our CRM, or whenever we add a new uh entity to the CRM, tell Agent Work, like, hey, I have this row, fill it out, and I want the information to be correct, and then our system will go figure it out, solve the problem, and send you back the data.
00:25:32.880 --> 00:25:38.240
So you can call Agent Work as an API as well, which is useful for kind of continuous uh work.
00:25:38.720 --> 00:25:40.079
Nice, nice, nice.
00:25:40.319 --> 00:25:45.200
Um I'm not a developer, I'm a business guy.
00:25:45.279 --> 00:25:47.119
Um everybody's a developer now.
00:25:47.359 --> 00:25:55.119
Well, it's funny that you say this because I I'm a CPA by background, like a 25 years in consulting.
00:25:55.279 --> 00:26:05.839
Um but I uh on a continuous basis, I have Visual Studio Visual Studio and Cloud Code running on my machine on my third screen on a continuous basis.
00:26:06.000 --> 00:26:12.559
And so in in cyber intelligence platform, we have uh plugged in a whole bunch of uh API keys.
00:26:12.640 --> 00:26:18.559
Like, I mean, I have my Apollo and my Snowview key and OpenAI and Tropic, like just the list is on and on and on.
00:26:18.720 -->
00:26:24.160
But what I find um this is just experiential learning.
00:26:24.400 --> 00:26:30.240
The the LLM that they find to be the best for kind of enrichment is Grok.
00:26:30.559 --> 00:26:33.279
Like open AI is data, it's better data, right?
00:26:33.359 --> 00:26:34.400
That's better data.
00:26:34.720 --> 00:26:41.920
But I think that they also might be some governance mechanism because cloud is amazing at executing difficult tasks.
00:26:42.319 --> 00:26:48.240
OpenAI is kind of like PG, everything comes out, everything that comes out of ChatGPT is PG.
00:26:48.559 --> 00:26:53.920
Um, Cloud is basically on a technical, and Grok is like there's no almost like there's no limit.
00:26:54.000 --> 00:26:56.559
Like everything is like whatever you want it to be.
00:26:56.799 --> 00:26:58.480
Yeah, I think that's correct, right?
00:26:58.559 --> 00:27:16.240
And I think we're we're like operating in some variation of those spaces as well, where like we like currently the current model of aging work is built on top of ChatGPT, okay, but it has access to cloud as well, so like it can execute claud code if it needs to, and it can use any APIs that we have available and like different services.
00:27:16.319 --> 00:27:28.880
So like AgentWork is not trying to be the best web scraping product in the world or the best code writing product in the world, it's the best place to go with a task, and then we will figure out what the best tool is and we will use it for you.
00:27:29.039 --> 00:27:35.519
So you don't have to know, and you don't have to care how the source it is made, you just want your table, yeah, yeah, yeah.
00:27:35.680 --> 00:27:36.319
Exactly.
00:27:36.640 --> 00:27:43.759
Okay, um, and so how does agent work continuously learning in in the background?
00:27:43.920 --> 00:27:48.799
Because I'm assuming that some tasks you've anticipated, but sometimes are maybe different.
00:27:48.880 --> 00:27:54.640
Kind of like what are some of the edge cases that you would have seen kind of happen at the agent work?
00:27:55.119 --> 00:28:00.559
Yeah, so uh we constantly see tasks that are like, hmm, okay, I didn't expect this.
00:28:00.640 --> 00:28:01.839
Like, yeah, that's kind of weird.
00:28:01.920 --> 00:28:03.920
How do we do we even want to solve this task?
00:28:04.079 --> 00:28:06.640
But I so like I guess there's two types of questions, right?
00:28:06.720 --> 00:28:08.000
Like, what is agent work?
00:28:08.160 --> 00:28:10.400
What's more more expected and unexpected?
00:28:10.480 --> 00:28:17.920
And I think for that, the way we think about it is like things you could in theory give to a freelancer is good for agent work, right?
00:28:18.000 --> 00:28:26.640
If it if it leans on like an incredible amount of context that only you have or your team have, and you don't give that context to agent work, then it can't help you, right?
00:28:26.880 --> 00:28:30.720
You can give it all the context, and sure, then agent work can solve it.
00:28:30.799 --> 00:28:35.599
But if it's just ask a random freelancer without context to solve a problem, they couldn't do it either.
00:28:35.839 --> 00:28:40.799
Um, I think agent work currently is very good at like one-off tasks.
00:28:40.960 --> 00:28:44.559
Like, here's just a task, make a spec, give me the results.
00:28:44.720 --> 00:28:48.640
Okay, whereas like an employee is more like on an hourly basis kind of thing.
00:28:48.720 --> 00:28:54.240
That's the next step for agent work, it's more like long horizon employee-like uh interactions.
00:28:54.960 --> 00:28:59.839
And then I think um what's the other question you asked?
00:29:00.319 --> 00:29:01.839
Or maybe I was just trying to say something.
00:29:02.160 --> 00:29:03.200
Edge cases.
00:29:03.920 --> 00:29:07.680
Yeah, I think like we see we see all sorts of hard problems, right?
00:29:07.759 --> 00:29:12.000
Like um, yeah, everything from like document processing and so on.
00:29:12.079 --> 00:29:20.799
But obviously, when people come to us and say, like, I need to build an app, what ATWork should do, and what ATWork does, it's it's writes back and says, like, I think you should just use cloud code for that.
00:29:20.960 --> 00:29:26.640
Like, we don't want to necessarily entrench on like where we don't see ourselves being the best product.
00:29:26.880 --> 00:29:31.920
Um but we have like things that we're really good at, which like research type problems right now.
00:29:32.319 --> 00:29:49.599
So, how do you move like and I'm assuming that it's it's not just agent work, but there's so many other companies that I'm assuming that they're going to um completely disrupt like the the business of companies like AppWork and Fiverr that that have like uh they build an army of freelancers.
00:29:49.920 --> 00:30:09.680
So, how do you move from one-off tasks to teach the employees that you've done everything that you need to do in terms of them building institutional knowledge and then they have the context that they need in order for them to build this if it as if they're one of your employees?
00:30:10.000 --> 00:30:14.960
Yes, I think like and I also remember the other thing I wanted to say, so I'll try to remember that as well.
00:30:15.119 --> 00:30:24.160
But like I think fundamentally, my perspective on this is that an employee is a long-term thing that executes tasks over and over, right?
00:30:24.240 --> 00:30:28.880
So they have like a long-term memory, but then what they do is tasks, fundamentally, right?
00:30:29.039 --> 00:30:32.079
So the current version of agent work is just the task part.
00:30:32.160 --> 00:30:36.240
You give it a task, it solves it, and it gives you back a result, one-off.
00:30:36.640 --> 00:30:46.640
And then employee mode of aging work is just a long-term horizon thing with memory, but every time it needs to do something, it uses tasks, right?
00:30:46.720 --> 00:30:55.440
So you can take what we already have for tasks, and then you can just do
task after task after task and remember what you've done before and update your knowledge and memory and so on.
00:30:55.599 --> 00:30:58.559
Um, so in that sense, I think it's kind of easy for us to bridge the gap.
00:30:58.640 --> 00:31:04.480
If we can solve tasks well, it's not that hard to make an employee mode in agent work.
00:31:04.799 --> 00:31:07.759
The other question you asked that I didn't answer was around like how does it get better?
00:31:07.920 --> 00:31:08.799
How does it learn?
00:31:09.039 --> 00:31:20.400
And I think that's one of the big advantages of how we think about agent work is that every time you run a task through agent work, we don't just get the model to solve it, we also get a human to help and verify.
00:31:20.559 --> 00:31:28.079
And that means that every time we solve a task with agent work, we now get a very nice piece of data that we can use next time you get a task.
00:31:28.319 --> 00:31:31.519
So we obviously reuse all of these learnings every time.
00:31:31.680 --> 00:31:48.000
So whenever you're done with a task as a human and you verify it and you say, like, this is now done and good, the last step for you as a human is to like put those learnings into the database and say, like, next time we see something like this, we should probably not do that or that, we should do this instead.
00:31:48.160 --> 00:31:51.039
This is what kind of the feedback is from this task.
00:31:51.200 --> 00:32:00.799
So we build a big database of feedback and learnings from using the product, um, which is how agent work in itself can get better day by day.
00:32:00.960 --> 00:32:06.559
Um, and also like that that's just like an incredibly interesting piece of data for us to kind of work with.
00:32:06.880 --> 00:32:13.440
And when you say the human, you mean the human that's actually asking for the task to be performed, then human in the middle.
00:32:13.599 --> 00:32:13.920
No?
00:32:14.240 --> 00:32:14.880
No, no, no.
00:32:15.039 --> 00:32:15.839
Our our people.
00:32:16.000 --> 00:32:18.240
So like our human experts, as we call them.
00:32:18.319 --> 00:32:23.839
So a human expert at agent work is like an employee of ATWork who is helping agents solve tasks.
00:32:23.920 --> 00:32:33.680
So if you come in with a task, our agent will try to solve it, and then a person will be associated to the task, and their job is to make sure that the result is actually good enough.
00:32:33.839 --> 00:32:35.440
And that's kind of that's on us, right?
00:32:35.519 --> 00:32:43.279
That's on the house that there's a human involved because that's the way we ensure that the output is good, but it's also the way we build better data for the future.
00:32:43.599 --> 00:32:44.720
So, how do you scale?
00:32:44.799 --> 00:32:52.799
I mean, this this obviously you over time I mean some problems are going to be repeatable as they're solved, you don't need a human.
00:32:52.880 --> 00:32:53.759
I get that.
00:32:54.160 --> 00:32:59.039
Yeah, but how do you scale if if you always have human uh on your on your end?
00:32:59.599 --> 00:33:04.079
So, like, obviously, like the the way to do that is to make the humans more and more effective.
00:33:04.240 --> 00:33:09.839
And like inside agent work, also in the current version, you have like an accuracy scale in the beginning.
00:33:10.000 --> 00:33:14.160
When you give it a task, you can decide like, do I just want the agent to give a stab at it?
00:33:14.240 --> 00:33:15.039
No humans.
00:33:15.279 --> 00:33:16.880
Do I want high accuracy?
00:33:16.960 --> 00:33:25.359
Which means we'll run the task multiple times in parallel, we'll cross-check against each other and do very proper QA, but still just the robot.
00:33:25.519 --> 00:33:28.000
And then we have like, no, I want like human in the loop.
00:33:28.079 --> 00:33:30.000
I actually need a human to verify this.
00:33:30.160 --> 00:33:32.880
So you can choose like a lower version.
00:33:33.440 --> 00:33:38.319
Today we give we have humans on everything because it's important for us to like make sure the data is good.
00:33:38.480 --> 00:33:43.200
Um, if you pick the high version, right, which we charge more per token, basically.
00:33:43.279 --> 00:33:45.279
So like the task will cost more to run.
00:33:46.000 --> 00:34:16.239
But in the beginning, obviously, a human is idling a lot, they're not very effective, but over time we're we're gonna see, according to my hypotheses and calculations, right, that a single human can work across potentially a hundred different tasks in parallel, where an opwork freelancer is working on maybe like three tasks or two tasks at the same time, we can like make them incredibly efficient because they don't actually have to do the work, they just have to guide and help and orchestrate and validate and check and so on.
00:34:16.559 --> 00:34:18.480
So, let me ask you a question.
00:34:18.639 --> 00:34:30.480
So, about a month or so ago, a company out of Canada here approached us to partner with us, and I I don't have the technical knowledge to assess this.
00:34:30.960 --> 00:34:44.320
Their claim is that they can get to zero hallucinations, they can move from a probabilistic model to a deterministic model, and so you were like it.
00:34:44.480 --> 00:34:55.119
I wouldn't mind if you can give us a bit of a background on your on your education because you were trained in this, you worked at CERN, like you like this is a question that you you you can knowledgibly answer.
00:34:55.280 --> 00:34:57.039
Like, is this possible?
00:34:58.400 --> 00:34:59.840
I don't think so.
00:35:00.880 --> 00:35:03.280
Okay, yeah, so I have I have I'm a mathematician, right?
00:35:03.360 --> 00:35:06.960
I have a PhD in ML, but it was like pre-the-lm days, of course.
00:35:07.039 --> 00:35:15.519
So I don't I haven't like studied extensively transformal models and so on in as part of my PhD, but I have a fairly good grasp of of the field, right?
00:35:15.599 --> 00:35:18.079
I
think can you stop hallucinations?
00:35:18.239 --> 00:35:23.760
I don't see how that would ever be possible, given that humans hallucinate, right?
00:35:23.840 --> 00:35:28.480
Like it's not like that's some bug in the LLM architecture that gives you hallucinations.
00:35:28.639 --> 00:35:37.760
Hallucinations come from the fundamental idea that the model can make a wrong prediction, right?
00:35:37.840 --> 00:35:41.360
Like hallucination is just a term we've chosen for that.
00:35:41.599 --> 00:35:47.679
Um, obviously, LLMs have a way to hallucinate in some interesting, specific LLM type ways.
00:35:47.840 --> 00:35:54.960
Um, if you ask it in Danish what a beefsteak tomato is, it'll like make all sorts of crazy claims that are totally unsubstantiated.
00:35:55.119 --> 00:36:00.960
But so it's like it's it it hallucinates in weird ways, but but you can see the same for humans, right?
00:36:01.039 --> 00:36:12.960
I think one of the examples of of humans also being kind of broken is there's a lot of these like classical visual puzzles of like you see something and it looks like one line looks much longer than the other line, but they're actually the same length.
00:36:13.039 --> 00:36:15.599
It's kind of like a human, a human bias, right?
00:36:15.679 --> 00:36:23.199
It's a human error in the brain, and humans aren't like the computer would never make that mistake, it would just like calculate the length of the lines, yeah.
00:36:23.519 --> 00:36:24.800
But humans are also idiots.
00:36:24.880 --> 00:36:28.159
We just we're used to how humans are idiots and not how AIs are idiots.
00:36:28.320 --> 00:36:31.920
So could you make the model never make mistakes?
00:36:32.079 --> 00:36:37.199
Obviously not, but could you make it you could make all sorts of heuristics, right?
00:36:37.280 --> 00:36:44.960
You can look at like the probability of each token and say, like, oh, this looks this is like this was generated with like a lot of variability in it.
00:36:45.039 --> 00:36:50.320
So you can you can tune it, you can make it better, you can like highlight the challenges.
00:36:50.480 --> 00:36:52.400
Can you make a hallucination-free model?
00:36:52.480 --> 00:37:00.960
I think that's philosophically challenging to uh essentially it essentially the claim they have is it's it's almost kind of like a blockchain.
00:37:01.119 --> 00:37:02.800
Uh information flows through it.
00:37:03.199 --> 00:37:06.559
That sounds like a scam blockchain?
00:37:06.719 --> 00:37:07.280
What the hell?
00:37:07.519 --> 00:37:12.079
No, no, so that's just like a stamp saying, like this is this is verifiable information.
00:37:12.159 --> 00:37:34.400
So I was trying to understand is this like a uh a rack model that pulls information because you know that it comes from a structured data, the data is verified, but I'm like, okay, but uh this is a assembly of information if it's just a rack model, like so like if you if you constrain the model to only talk about what's in the
secret database, then sure you can make it hallucination free, but then it's also not very useful because it only talks about like very few things.
00:37:34.559 --> 00:37:40.800
Like you can you can make a hallucination free calculators are great, they're hallucination free, right?
00:37:40.880 --> 00:37:43.679
But they're also only able to multiply and add numbers and so on.
00:37:43.760 --> 00:37:46.239
So like I don't think that's that's not very interesting.
00:37:46.400 --> 00:37:54.960
I think what's cool about LLMs is they can talk about anything, yeah, also things they've never seen before, which is also that's the place when they get into trouble, right?
00:37:55.119 --> 00:38:03.920
If you give them a problem and don't give them web search and ask them to reason about something that makes no sense, they're gonna try and they're gonna fail.
00:38:04.239 --> 00:38:06.480
Um, but that's also what makes them cool, right?
00:38:06.559 --> 00:38:08.400
They can create poems, for example.
00:38:08.639 --> 00:38:10.480
How can you do that without hallucinating?
00:38:10.559 --> 00:38:11.840
For example, yeah, yeah.
00:38:12.000 --> 00:38:13.440
I mean it's it's amazing.
00:38:13.599 --> 00:38:20.400
Like now I'm like there's these unique apps, like there's an app called Suno that that creates music and beautiful.
00:38:20.559 --> 00:38:22.000
I've used it, I love it.
00:38:22.159 --> 00:38:32.480
But now I'm seeing the LLMs go into this basic kind of like to your point around big companies are gonna become the the companies of everything, and so it it kind of makes me question as to what they are.
00:38:32.639 --> 00:38:36.800
But yeah, one question they have for you is on reinforced learning.
00:38:37.039 --> 00:38:55.119
A lot of people and a lot of companies use AI in a very simplistic way, it's almost like a uh a search box in in on a browser rather than to perform tasks, and so even performing the tasks it it in in many ways is very simplistic.
00:38:55.360 --> 00:38:59.119
How do you how do you build a reinforced learning layer on top?
00:38:59.679 --> 00:39:17.760
Like like how do you build something that continuously learns itself and it because you're right, a job is a combination of tasks, but how do you continuously get more and more tasks off a human plate and onto a digital worker's plate?
00:39:18.800 --> 00:39:20.079
That's a hard question.
00:39:20.239 --> 00:39:27.119
I think I think the best strategy for many companies though is to make simple AI implementations.
00:39:27.280 --> 00:39:32.960
Like you don't necessarily want to change your product into a big text area and like now you just talk, talk to the product.
00:39:33.119 --> 00:39:43.599
Like, obviously, that's the feature everybody first, everybody got an AI chatbot, and then everybody got a talk to the product model where you can like ask the product to do certain things, which is like that's cool.
00:39:43.840 --> 00:39:55.760
I think a lot of the powerful AI features are not that visible because they're like happening behind the scenes, um populating certain data based on other data, like ingesting PDFs and converting them into something.
00:39:55.920 --> 00:40:04.559
I think the best way to as a company though to get more digital and more automatic is to use more software.
00:40:04.800 --> 00:40:08.320
Because like once you've put something in software, then you can automate it.
00:40:08.480 --> 00:40:18.400
I think the the biggest challenge is like taking something that you're not doing in like some vertical SAS and then putting it into a piece of vertical sass.
00:40:18.639 --> 00:40:24.800
Because once you do that, that that product will help you push your automation forward, right?
00:40:24.960 --> 00:40:32.719
If you're writing all your blog posts in Google Docs and then copying them into your blog, then that's very hard, right?
00:40:32.800 --> 00:40:42.639
But if you write them in some blog writing product, then that product can build all sorts of cool features for SEO optimization and stuff like that.
00:40:42.880 --> 00:40:52.880
So I think just like use more software and use software that is great at using AI, that that kind of helps push everybody forward very fast.
00:40:53.199 --> 00:40:54.800
So, how would you think about it?
00:40:54.960 --> 00:41:04.639
And and and and we we've built workflows around because we write the the content in one piece and we have to obviously propagate it and but have to run it through SEO and AR.
00:41:04.960 --> 00:41:14.800
Um how do you build this orchestration layer so it doesn't become like a Frankenstein system of like I have this and this and this and everything?
00:41:15.119 --> 00:41:16.400
I think it will be for a while.
00:41:16.559 --> 00:41:36.320
I think it will be like a Frankenstein's layer, and I think that's because the world is moving so fast, like there's not like everything isn't connected yet, which is one of the biggest challenges for like LLMs right now, and like where agent work has a big step up compared to just ChatGPT, is that the world is like full of software, none of it really talks together.
00:41:36.480 --> 00:41:42.400
There's all sorts of attempts with like APIs and MCP and whatnot, but like it doesn't actually work that well.
00:41:42.559 --> 00:41:48.480
Uh so none of the products actually communicate in a nice way, and everybody has their own agent and so on.
00:41:48.639 --> 00:41:58.159
But I think we're not that far away from the world, I guess, where a person has an a core agent in some way that they talk to.
00:41:58.320 --> 00:42:15.599
There's like the main the main agent, and that could be like an interface into multiple agents, but like I go into one place and I write, I want something done, and then that agent is now responsible for talking to all the other agents and all the software I have out there and saying, like, okay, David wants a blog post.
00:42:16.079 --> 00:42:28.239
Let me use the blog software
he has and let me use uh Webflow to push the blog out and let me write somebody an email, and like and the problem is every company also wants to own that initially, right?
00:42:28.320 --> 00:42:30.960
Everybody company wants to be the agent you go to first.
00:42:31.199 --> 00:42:44.400
So right now, complete fragmentation, yeah, and then we're gonna see at some point some sort of like convergence to a standard or uh there's a product called conductor, for example, for coding, right?
00:42:44.480 --> 00:42:48.480
Which is like it's a product just for managing cloud code and other tools.
00:42:48.639 --> 00:42:57.039
Okay, but it's like so you open that instead of opening clawed code directly, because then you can use cloud code more effectively and you can use codecs at the same time and so on.
00:42:57.199 --> 00:43:02.159
I think we're gonna see these like types of meta products um appear for different things.
00:43:02.239 --> 00:43:04.719
And open claw is one of the classical examples of this.
00:43:04.800 --> 00:43:11.920
It's like, hey, here's a product that can do anything, it will just and you give it full permissions and it can go completely haywire.
00:43:12.239 --> 00:43:18.000
But but the premise and what people liked about open claw is that yeah, it's just it's a thing that does it all.
00:43:18.159 --> 00:43:18.960
Does it work?
00:43:19.440 --> 00:43:21.360
Usually sometimes is it scary?
00:43:21.440 --> 00:43:24.800
Yes, but like but it's the it's the UX we want, right?
00:43:24.960 --> 00:43:35.199
The thing that people want right now and they can't really get it yet, is that thing where like there's just one product and you always talk to that one product and it solves any problem you have.
00:43:35.519 --> 00:43:38.559
So let me just juxtapose the two strategies.
00:43:38.719 --> 00:43:45.119
So open claw can do anything and everything, but there's no human in the middle or human in the loop.
00:43:45.280 --> 00:43:48.000
Uh agent work is human.
00:43:48.559 --> 00:43:57.920
So you get high like significantly higher quality when you have a human and in in using this to to essentially accelerate the enforced learning cycle.
00:43:58.079 --> 00:44:09.679
Um If you are comparing scaling strategy, obviously, if if I'm a user, I want the highest quality possible because it gives me precision, gives me accuracy.
00:44:10.000 --> 00:44:18.480
Could this be a strategy that open cloud is using to say, well, we're just gonna go and acquire the data and then figure out a way to use this data to to make the system better?
00:44:18.639 --> 00:44:23.920
Kind of like compare the quality versus the speed.
00:44:24.239 --> 00:44:26.800
I think like the data we're gathering is very interesting, right?
00:44:26.880 --> 00:44:30.960
So that way that that data is an interesting acquisition target one day, I guess.
00:44:31.119 --> 00:44:36.400
But I think like the way I think about open claw and agent work is like open clause should just use agent
work sometimes.
00:44:36.559 --> 00:44:40.320
Like when you give it a task and say, like, make no mistakes, like this can't go wrong.
00:44:40.480 --> 00:44:46.639
Okay, then open clause solution should be like, well, uh my client here clearly wants high accuracy.
00:44:46.719 --> 00:44:48.000
Let me find a way to do that.
00:44:48.159 --> 00:44:51.360
And that could be using agent work or something else, right?
00:44:51.440 --> 00:44:58.559
By saying like, okay, I'm gonna spend the money now and go and actually get a human to validate this because I really need accuracy here.
00:44:58.719 --> 00:45:01.199
Um that's also one of the ways to think about 18 work.
00:45:01.440 --> 00:45:10.320
One part is we use humans to actually get you to the goal, but also we use humans to give you a stamp of validity.
00:45:10.400 --> 00:45:14.239
Which we're not promising that the result is correct, we can never promise that.
00:45:14.400 --> 00:45:17.679
But what we can promise you is that a human have looked at it.
00:45:17.760 --> 00:45:21.360
So if there is an error, it's a human error, which you can never really get.
00:45:21.519 --> 00:45:24.960
It's hard to get much better than like the combination of robot and human.
00:45:25.119 --> 00:45:29.440
Yeah, if they both approve, then that's best best in class, I guess.
00:45:29.760 --> 00:45:32.239
So let me put my own my own hat.
00:45:32.480 --> 00:45:41.199
So I'm uh uh I'm a CPA, and so in the in the in the audit world, we have kind of three levels of assurance.
00:45:41.360 --> 00:45:47.519
Um, we would have like no assurance, which is like we've we've done we've just it's it's called compilation game.
00:45:47.679 --> 00:45:49.280
We've just compiled data.
00:45:49.599 --> 00:45:55.360
Then we have negative assurance, meaning that like nothing has come to our attention, so that's a review engagement.
00:45:55.440 --> 00:46:03.760
Then we have audit where we have done everything possible within reasonability to confirm that the information is is correct.
00:46:03.920 --> 00:46:07.760
We there's no absolutes, but it's a reasonable level of assurance.
00:46:07.840 --> 00:46:13.199
Yeah, so um with with agent work, would it be like kind of like the comparison?
00:46:13.360 --> 00:46:23.280
Like uh I can choose my task and I can apply a review engagement, I can apply audit level of assurance, and then open claw is kind of like no assurance.
00:46:23.360 --> 00:46:25.280
It's just like we've just assembled stuff.
00:46:25.360 --> 00:46:27.920
And can you toggle within agent work?
00:46:28.159 --> 00:46:31.119
What level of assurance would you would would you give on the output?
00:46:31.440 --> 00:46:34.639
Yeah, because that's one of the first boxes that appear after you give your task.
00:46:34.719 --> 00:46:47.760
It's like, do you want fast mode, which is like basically your no assurance, or do you want high accuracy, which is kind of the like we're gonna QA and we're gonna do it in multiple times, and we're gonna do that and not find anything, then we're gonna send it to you.
00:46:47.840 --> 00:46:50.320
And then audit mode, basically we call it premium, right?
00:46:50.400 --> 00:46:53.920
But like there is gonna be a human that looks at this before you get the result.
00:46:54.239 --> 00:47:02.079
So when you get a result back, like some human has looked at it and verified that this is actually living up to expectations, and then send it to you.
00:47:02.480 --> 00:47:04.000
And what does the human look at?
00:47:04.320 --> 00:47:10.079
Does it look at it kind of like the the code that's being executed to to execute a task to make sure?
00:47:10.480 --> 00:47:12.480
Yeah, so they they yeah, they engage in different ways.
00:47:12.559 --> 00:47:19.519
They have like the the most important thing is like at the end, they actually look at the results and say, like, does this does this actually make sense?
00:47:19.679 --> 00:47:21.199
Does this actually solve the problem?
00:47:21.440 --> 00:47:23.360
Do all the links work and so on?
00:47:23.519 --> 00:47:26.480
Yeah, but then they're also engaged along the way.
00:47:26.639 --> 00:47:33.199
So like at some point the agent might like realize, okay, I'm actually like this is going weird, like this is not really looking well.
00:47:33.360 --> 00:47:40.079
Like, let me engage the human already now, and then the human can come in and say, like, no, that's a bad path, don't go that way, go in this way instead.
00:47:40.239 --> 00:47:47.440
So they also help get to the goal, and then the agent helps give a proposal for what the human should verify.
00:47:47.679 --> 00:47:57.039
So if the agent knows, like, this is kind of my weak spot, I think this is what you should be checking, or I would like spot checking on like five rows in this table.
00:47:57.119 --> 00:47:58.960
Like, these are five rows you could check.
00:47:59.199 --> 00:48:07.199
Because obviously, for agent work to work, it can't be that the human have to solve the whole task again to verify that the solution is correct.
00:48:07.440 --> 00:48:11.039
That that wouldn't be very effective, then it's just a human and not in the loop.
00:48:11.199 --> 00:48:24.960
Um, so we have to find a way to say the agent should do the work, and the agent can be quite good at figuring out like what are the weak points, and then we'll generate a proposal for like what we think the human should check.
00:48:25.119 --> 00:48:30.480
But then they can also do their own checks basically to say, like, well, actually, I think this I should check as well.
00:48:30.559 --> 00:48:34.320
And then finally, the the client gets the solution back, and then they verify.
00:48:34.559 --> 00:48:40.400
Like, if they're not satisfied with the solution, we're notified, and then we give it another round, right?
00:48:40.480 --> 00:48:44.159
And we figure it out, and then that's a big learning check for next time.
00:48:44.239 --> 00:48:46.880
Like, actually, there was a
problem here, and we didn't catch it.
00:48:47.119 --> 00:48:48.719
That's that's a bad thing for us, right?
00:48:48.800 --> 00:48:50.559
So we need to go on and improve.
00:48:50.960 --> 00:48:53.360
Wow, that's amazing.
00:48:53.519 --> 00:49:00.480
Um, what um what's your kind of prediction?
00:49:00.559 --> 00:49:10.400
Like if we're if we're I'm not trying, but if we're trying to be a little bit more provocative and controversial, what does the world look like in 5, 10, or 15 years?
00:49:10.480 --> 00:49:16.000
I'm not asking for 30 or 50 years, but kind of like, what does the world look like in 5, 10, 15 years?
00:49:17.280 --> 00:49:22.400
Honestly, I think I'm quite a techno-optimist and I am very AI pilled.
00:49:22.480 --> 00:49:26.559
I've been AI pilled since I was 13 and trained my first neural network.
00:49:26.880 --> 00:49:32.559
I think that we will not be working as much or at all, many humans.
00:49:32.719 --> 00:49:39.360
I think that it's gotta be a while before like robots and so on are solved properly, but like it's just a matter of time.
00:49:39.599 --> 00:49:49.519
And I think I just don't see like people compare it to the industrial revolution and so on, are like, oh, like no, the machines become better and then humans get new tasks.
00:49:49.599 --> 00:49:52.000
But I just don't see humans catching up to this one.
00:49:52.159 --> 00:50:06.239
Like, if you actually get to proper ATI where robots are better at everything than humans, humans will do things that we want humans to do, like take care of babies and like talk to your elders and stuff like that.
00:50:06.480 --> 00:50:16.719
And I don't and like luxury things where you want it to be done by a human, but like for everything else, I don't think humans are necessary, and like will we all just like lie on the couch?
00:50:16.800 --> 00:50:25.760
It's probably like not realistic, but we will engage in things that make us happy, like playing chess, even though the robots are better at chess than us, we still do it.
00:50:26.000 --> 00:50:35.760
Um, we'll read books and not just get summarized books because we like reading a book, and we'll we'll do work for fun, like we'll do work because it fulfills us.
00:50:35.920 --> 00:50:38.559
Um it's kind of like Maslow's hierarchy, right?
00:50:38.639 --> 00:50:45.360
Like we're gonna satisfy all the bases pretty easily, at least in some like unevenly distributed way, right?
00:50:45.440 --> 00:50:49.440
Like it's gonna happen in the Western world first and for the rich people first, and so on.
00:50:49.679 --> 00:50:57.440
Um, but but we are going towards a future where the society has to kind of adapt in some way, right?
00:50:57.519 --> 00:51:02.960
Because if suddenly people stop working, like what actually happens, I'm not smart enough to figure that out, right?
00:51:03.039 --> 00:51:05.280
Like it's it's complicated.
00:51:05.440 --> 00:51:07.119
Taxes, what do we do with taxes?
00:51:07.199 --> 00:51:08.159
What do you do with labor?
00:51:08.239 --> 00:51:09.519
What do you do with salaries?
00:51:09.599 --> 00:51:10.239
Like, I don't know.
00:51:10.400 --> 00:51:12.079
It's it's all very complicated.
00:51:12.159 --> 00:51:19.440
But what I will think is is gonna happen in the short term is that it's not like the world changes tomorrow and like suddenly everybody gets fired.
00:51:19.599 --> 00:51:21.920
I think we're gonna see people competed away.
00:51:22.079 --> 00:51:23.920
Like we're gonna see new people.
00:51:24.239 --> 00:51:29.440
We see some companies firing a lot of people, but I think what's more important is like new companies not hiring.
00:51:29.760 --> 00:51:42.239
Like we're gonna see more and more people starting new ventures, not hiring anybody, doing it all with AI, and out-competing the established players who are not doing that because they don't like firing people and like they like to be managers of many people and so on.
00:51:42.400 --> 00:51:49.039
I don't want to be a manager of many people, so I'll try to not hire, and then my unit economics are better than yours, and then I can outcompete you, right?
00:51:49.199 --> 00:52:02.559
So I think it'll be a slow transition, but suddenly it will appear to be very fast that everybody's gonna have to adapt to a world where humans are not that important um as like labor force.
00:52:02.719 --> 00:52:04.960
Yeah, they'll have to be important for some other reason.
00:52:05.199 --> 00:52:05.920
Oh, for sure.
00:52:06.000 --> 00:52:28.719
And and I think that probably the biggest disruption that we're going to see, it's uh um not necessarily, I mean, there's definitely going to be elimination job uh of jobs, but what I'm envisioning or what I'm seeing is that if you think about a job as an assembly of tasks, that assembly of the tasks is going to shift the most most dramatically.
00:52:28.880 --> 00:52:37.679
It's not that humans are suddenly going to be all humans are gonna be out of a job, it's just that the tasks they were doing before versus the tasks they're doing now are just different.
00:52:37.760 --> 00:52:44.079
And in some cases, it's gonna be radically different, and it's gonna eliminate some jobs as a job title completely.
00:52:44.320 --> 00:52:48.000
In some cases, it's just going to transform what's included in this job.
00:52:48.159 --> 00:53:05.519
But I wanted to ask you, um, a lot of AI currently resides in kind of in the digital world, but you're starting to see the shift into the physical world with these robot farms, the training kind of how do you envision agent work moving to the physical world?
00:53:06.000 --> 00:53:08.480
Oh, I'm not sure we will, honestly.
00:53:08.639 --> 00:53:20.960
I don't think like I don't think agent work is like built for the physical world, but on the other hand, like the good thing about agent work is that it's kind of like universal in a way.
00:53:21.119 --> 00:53:26.320
You can you can write to agent work right now, like, hey,
I need a cup of coffee delivered to this place tomorrow.
00:53:26.480 --> 00:53:33.599
The agent will say, I can't do that, but then a human in the loop will say, like, I'll order the coffee, and then I'll call the coffee shop.
00:53:33.679 --> 00:53:38.159
Like, I'll be the human in the loop, for example, call the coffee shop and order you a coffee, and then you'll get your coffee.
00:53:38.320 --> 00:53:41.920
So there's no reason why agent work can't solve any problem.
00:53:42.079 --> 00:53:44.320
That doesn't mean we should be ordering people's coffee, right?
00:53:44.400 --> 00:53:49.760
That's not the code of aging work, but it it's kind of an everything product in that sense.
00:53:50.079 --> 00:53:59.039
So, do you see aging work kind of being like the ingress point for tasks that that uh transcend the digital and the physical world?
00:53:59.119 --> 00:54:01.920
And I just uh I was just gonna walk through an example.
00:54:02.159 --> 00:54:10.719
So yesterday I was listening to a podcast, and uh uh I'm I'm not a gamer, I've never been a gamer, but the example was Pokemon Go.
00:54:10.960 --> 00:54:18.559
And so Pokemon Go um apparently sold the game for billions of dollars, but they they kept the video data.
00:54:18.960 --> 00:54:30.400
And so now they're licensing the video data because obviously people were walking through with a uh device recording, and so like kind of like the way Google Maps goes in the Street View, they they're now selling the data.
00:54:30.559 --> 00:54:46.639
So if I was to play through an example, um somebody's ordering a coffee, um um, they go to agent work, uh, the the order gets passed on to a delivery app, the delivery app goes out and and hires uh uh um a human to go and deliver.
00:54:46.719 --> 00:54:48.159
Is that a possibility?
00:54:49.679 --> 00:54:57.599
Okay, absolutely, and then the next time the agent will know that the last time this happened, then what the human did was order a coffee through the service.
00:54:57.679 --> 00:55:02.079
So, like, I'll just try to do that now, and then hopefully next time it's all automatic.
00:55:02.239 --> 00:55:07.519
But like, we won't deliver the coffee, some service provider will drive out the coffee, obviously.
00:55:07.840 --> 00:55:09.360
Amazing, David.
00:55:09.599 --> 00:55:12.159
This has been a fantastic conversation.
00:55:12.239 --> 00:55:14.239
We've covered a ton of ground.
00:55:14.400 --> 00:55:19.440
Thanks again for joining, being uh so open about the lessons learned along the way.
00:55:19.599 --> 00:55:22.639
Um, I love having a conversation with you.
00:55:22.800 --> 00:55:34.719
I love seeing you build uh agent work that and and helping people adopt AI because what we're seeing is that this there's still this fear about using AI.
00:55:34.880 --> 00:55:41.039
And and and and our advice uh when we when we meet with with companies and clients is just put the hands on keyboard.
00:55:41.280 --> 00:55:46.400
There's no such thing as like I'm gonna go and learn it by watching a video or and whatnot.
00:55:46.559 --> 00:55:48.800
So thank you so much for joining us.
00:55:48.960 --> 00:55:49.920
That was amazing.
00:55:50.079 --> 00:55:50.880
Um, thank you.
00:55:51.119 --> 00:55:52.400
We'll see you in the next episode.
00:55:52.559 --> 00:55:53.519
Thanks, David.
00:55:53.920 --> 00:55:54.559
Bye.