From Tasks to Transformation: Scaling AI Adoption in Marketing with Spencer Tahil

WEBVTT
00:00:48.179 --> 00:00:49.060
Hello everyone.
00:00:49.060 --> 00:00:54.980
Welcome to another episode of Opscast, brought to you by MarketingOps.com, powered by all the no pros out there.
00:00:54.980 --> 00:01:01.859
I'm your host, Michael Hartman, flying solo this week or this episode again.
00:01:01.859 --> 00:01:11.060
But joining me today to dig into how to move from experiments to experimentation to execution with AI is our guest Spencer Tahill.
00:01:11.060 --> 00:01:25.379
I should have asked Spencer so you can thrust me if I mispronounce your name, is the founder and chief growth officer at Growth Alliance, where he helps companies design AI and automation workflows that drive growth across go-to-market, revenue operations, and marketing.
00:01:25.379 --> 00:01:32.980
His systems-driven approach focuses on using AI as a practical tool to free up strategic thinking and improve operational performance.
00:01:32.980 --> 00:01:34.820
Liz Spencer, welcome to the show.
00:01:34.820 --> 00:01:37.219
And uh remind me, where where in the world are you right now?
00:01:37.219 --> 00:01:38.260
I forget.
00:01:38.579 --> 00:01:42.180
And so I'm usually in Prague, uh, but currently I'm in Genoa.
00:01:42.180 --> 00:01:43.140
I'm in Italy.
00:01:43.140 --> 00:01:46.019
So uh yeah, that's uh that's a little bit of a change up.
00:01:46.019 --> 00:01:46.659
So yeah.
00:01:46.659 --> 00:01:47.939
It's a pleasure to be here.
00:01:48.260 --> 00:01:48.659
Well good.
00:01:48.659 --> 00:01:49.460
Glad to have you.
00:01:49.460 --> 00:01:55.060
I I knew it was Europe, I couldn't remember where, and I would have like if I had to actually remember, it sounds like I would have been off.
00:01:55.060 --> 00:02:03.620
So I what I do know is it's but at least early afternoon, if not late early early evening, there, right?
00:02:03.620 --> 00:02:04.260
Yeah.
00:02:04.739 --> 00:02:07.140
It's uh it's just turned almost 6 p.m.
00:02:07.140 --> 00:02:07.780
almost.
00:02:07.780 --> 00:02:08.259
All right.
00:02:08.340 --> 00:02:09.060
So there you go.
00:02:09.060 --> 00:02:09.300
Yeah.
00:02:09.300 --> 00:02:10.099
All right.
00:02:10.099 --> 00:02:12.019
So you're seven hours ahead of me.
00:02:12.019 --> 00:02:12.980
So good to know.
00:02:12.980 --> 00:02:13.460
All right.
00:02:13.460 --> 00:02:17.379
Well, let's when we start like with a little bit about your background.
00:02:17.379 --> 00:02:26.579
Like, how did you get into AI and automation, especially for like the go-to-market rev ops kind of domain?
00:02:27.219 --> 00:02:30.819
So it's kind of a long story made short.
00:02:30.819 --> 00:02:35.620
And I was always told to if you're gonna do something, do it right the first time.
00:02:35.620 --> 00:02:39.539
And even if it takes you longer, just make sure it works the first time.
00:02:39.539 --> 00:02:48.340
So um, when I was starting to work in kind of like a HubSpot sphere, I think there's probably gonna be a lot of people maybe in the Salesforce sphere listening.
00:02:48.340 --> 00:02:51.620
Um, I did a lot of freelance work in the HubSpot world.
00:02:51.620 --> 00:03:01.460
It was setting up marketing hub, starting up service hub, setting up sales hub, um, all of these different modules, as well as connecting everything through everybody's favorite marketing operations platform, Zapier.
00:03:01.460 --> 00:03:07.140
Um, at the time that was at the time, uh that was kind of like the leading edge of the market.
00:03:07.140 --> 00:03:17.620
Um, and as my kind of freelance business evolved, I was able to step away from you know a full-time engagement where I was a marketing manager at a startup actually here in Europe.
00:03:17.620 --> 00:03:29.939
Um, and I dove into doing full-time freelance work for a lot of American um Fortune 500 companies, like creating their HubSpot instances, helping them keep up to date with their modules and all their automations there.
00:03:29.939 --> 00:03:33.860
So how I fell into it was very naturally.
00:03:33.860 --> 00:03:38.500
It was just playing around with the workflows and the sequences features inside of HubSpot.
00:03:38.500 --> 00:03:47.379
And then when I wasn't able to build something inside inside the platform, just moving over into no code tool of Zapier was the first one that I learned really well.
00:03:47.379 --> 00:03:55.939
And then I played with make, but um, it wasn't until at least a few years ago that I kind of doubled down into into AI development.
00:03:55.939 --> 00:03:57.620
So that's what we do now.
00:03:57.620 --> 00:04:06.180
Um we we build out HubSpot portals mostly, sometimes in addio, but everybody wants to do more.
00:04:06.180 --> 00:04:10.740
And AI is kind of like putting the pedal to the metal at that at that rate.
00:04:10.740 --> 00:04:22.580
So what used to take a team of five or ten, you can do it in if you get a nice prompt going or an AI agent chain going, you can do it in a matter of like minutes or hours.
00:04:22.580 --> 00:04:25.139
You know, it's it's crazy the things that you can build now.
00:04:25.139 --> 00:04:26.019
And it's really interesting.
00:04:26.019 --> 00:04:29.300
So that's kind of long story made short, kind of fell into it.
00:04:29.300 --> 00:04:32.180
I love engineering, it's it's business engineering.
00:04:32.340 --> 00:04:34.819
So it's an interesting way of thinking about it.
00:04:34.819 --> 00:04:35.939
I hadn't heard that.
00:04:35.939 --> 00:04:41.620
Yeah, it's it's um it's interesting because so I'm just really curious.
00:04:41.620 --> 00:04:50.419
Like, do you because I've had to start doing this in my own head, like do you differentiate between AI and automation?
00:04:50.419 --> 00:05:01.299
Because I think to me, what I my view is that automation is a thing where AI can be a part of an automation automated workflow or whatever.
00:05:01.299 --> 00:05:04.980
Um, and I think I feel like a lot of people sort of conflate those.
00:05:06.100 --> 00:05:06.500
Yes.
00:05:06.500 --> 00:05:08.100
There's a huge issue.
00:05:08.100 --> 00:05:11.220
Um, the long answer to this is that they're two different things.
00:05:11.220 --> 00:05:13.620
Uh, or the short answer is that they're two different things.
00:05:13.620 --> 00:05:23.379
The long answer would be that there's a lot of misnaming in the industry, especially when it comes to anything regarding automation, anything regarding AI.
00:05:23.379 --> 00:05:24.820
And probably you've heard it.
00:05:24.820 --> 00:05:27.700
I just built an AI agent on LinkedIn or something like this.
00:05:27.700 --> 00:05:29.860
I've replaced a 20-person B2B sales.
00:05:29.860 --> 00:05:31.460
No, you didn't.
00:05:31.460 --> 00:05:34.259
And uh sometimes you can, you can do it.
00:05:34.259 --> 00:05:51.620
You know, like we've done cool things with Slack integrations and you know data across the world, but these types of linear flows, and I'm talking, you know, you have you know, single input, single output, you've got multiple inputs, multiple outputs.
00:05:51.620 --> 00:05:56.179
The more complex you go, the more essential AI is going to become.
00:05:56.179 --> 00:06:01.139
So when you build a workflow, my definition of a workflow is A, B, C.
00:06:01.139 --> 00:06:07.299
You have input, you have some sort of transformation step or processing, and then you've got C, you've got an output.
00:06:07.299 --> 00:06:32.340
And then you have an AI enhanced workflow, which is you have an input or you have multiple inputs, and then you have processing, the orchestration layer, and then the thinking that is going on, instead of saying, you know, if A put one, if B put two, if there's some sort of lead scoring and the lead scores have different weights, and you know, you have to calculate it on different weighted.
00:06:32.340 --> 00:06:37.220
It's a really good use case for AI if it's way too complex for formulas.
00:06:37.220 --> 00:06:40.899
In that instance, that becomes an AI-enhanced workflow.
00:06:40.899 --> 00:06:52.340
Where the industry is going now, and where there's a lot more confusion, is that there's workflows, AI-enhanced workflows, AI agents, and then there's MCP, which is model context protocol.
00:06:52.340 --> 00:06:54.659
So there's it's all different.
00:06:54.659 --> 00:07:09.700
And I would say the more, the more inputs you guys you have, the more context you have, the more transformation steps you have, and the more output possibilities you have, yeah, the more the more AI is gonna accelerate that.
00:07:09.700 --> 00:07:11.139
So that's how I define it.
00:07:11.139 --> 00:07:17.379
Workflow is just gonna be linear or it's gonna be a single path input, and then it's gonna do a formulation about output.
00:07:17.379 --> 00:07:24.500
And AI powered workflow is gonna do a lot more thinking, thinking that's been behind the scenes.
00:07:24.500 --> 00:07:25.059
Right.
00:07:25.059 --> 00:07:25.539
Yeah.
00:07:26.100 --> 00:07:26.419
Yeah.
00:07:26.419 --> 00:07:34.340
And it's uh you brought up MCP, which I still haven't quite wrapped my head around, but we can maybe we'll get there in the course of the conversation.
00:07:34.340 --> 00:07:44.740
But yeah, I want so this leads really to one of my next questions is that one of the steps that you think of towards I think a lot of people struggle with like, where do I start?
00:07:44.740 --> 00:07:45.139
Right.
00:07:45.139 --> 00:07:49.539
I want to do like I want to AI, I need to learn AI, I need to do something.
00:07:49.539 --> 00:08:04.580
And but what what one of the things that was interesting to me is when we talked before, you said one of the first steps towards doing automation, especially AI enabled or AI powered, whatever you want to call it, is identifying the things that piss you off, right?
00:08:04.580 --> 00:08:08.820
So I think that was a phrasing you used, but like what do you what did you mean by that?
00:08:08.820 --> 00:08:12.740
And like I how like maybe expand on it a little bit.
00:08:13.059 --> 00:08:13.539
Yeah.
00:08:13.539 --> 00:08:22.340
So um some people know this about me, some people don't know about me, but um, I I am at the end of the day, I want to do the least amount of work possible.
00:08:22.340 --> 00:08:24.580
And that's probably not a very professional thing to say.
00:08:24.580 --> 00:08:26.740
But I'm an Amazon, right?
00:08:26.740 --> 00:08:28.419
But but you know what?
00:08:28.419 --> 00:08:32.740
Like it's a game of efficiency and it's a game of focus.
00:08:32.740 --> 00:08:39.539
And when I used to work for a few different startups, even when I was like freelancing, it was all about trying to like optimize my day.
00:08:39.539 --> 00:08:47.460
If I can try to like build something that takes somebody eight hours to do and I can do it in two, oh my god, like you know, the value goes you know up the ladder, right?
00:08:47.620 --> 00:08:48.100
Right.
00:08:48.340 --> 00:08:55.220
When I start to think about when I want to not do something anymore, it's it's more philosophical.
00:08:55.220 --> 00:08:58.019
It's just like, I just don't have I don't have a great feeling, you know.
00:08:58.019 --> 00:09:03.860
Like I don't want to wake up, I don't want to turn the coffee machine on at six in the morning to have coffee at six and six thirty in the morning, right?
00:09:03.860 --> 00:09:07.699
Like you press a timer on your coffee machine the night before and then it's done, right?
00:09:07.699 --> 00:09:09.699
That's like very simple use case.
00:09:09.699 --> 00:09:14.659
When you start talking about it in like the business aspect, everybody has different pain points.
00:09:14.659 --> 00:09:22.740
And I'll get into that later, but I start by looking at the real ground level threat of what do I just hate doing every day?
00:09:22.740 --> 00:09:27.059
Like, yeah, okay, let's say I'm a sales guy and I hate picking up the phone and dying.
00:09:27.059 --> 00:09:31.220
Okay, maybe that's not the right, you know, industry for you to be working in.
00:09:31.220 --> 00:09:31.620
Right.
00:09:31.620 --> 00:09:39.539
But but if you if you're a sales guy and you hate going into Salesforce and HubSpot after every call, then what do you do?
00:09:39.539 --> 00:09:46.500
Like if you're a really good closer, but you're just terrible at just like putting stuff in this ARM, okay, that's your pain point.
00:09:46.500 --> 00:09:54.339
Let's solve that, let's automate that first so that you can focus on what you're good at and you guys can produce more, you know, you can be more efficient at your job.
00:09:54.339 --> 00:09:57.699
So that's why I always ask it's like what pisses you guys off the most?
00:09:57.699 --> 00:09:59.860
Ah, you know, I just want to get on calls all day.
00:09:59.860 --> 00:10:03.779
I just want to close, you know, make whatever, every whatever everybody wants to do what they want to do.
00:10:03.779 --> 00:10:09.059
But I start by looking at it as like, I don't like taking notes.
00:10:09.059 --> 00:10:10.019
Very simply.
00:10:10.019 --> 00:10:21.779
Like I enjoy the process of listening, I enjoy the process of conversing, but I don't, I'm not able to focus fully on you, Michael, if I'm just like, you know, off to the side writing my notes.
00:10:21.779 --> 00:10:30.419
So now you see all these AI note takers, and that's why I use, you know, like something like Fireflies or Fathom to be able to take my notes for me, because then I can focus on what I'm good at.
00:10:30.419 --> 00:10:32.899
So I've gotten rid of everything that I that annoys me.
00:10:32.899 --> 00:10:35.459
Now I can 100% give my focus to you.
00:10:35.459 --> 00:10:44.339
So I think like when you start doing, when you start making automations on the things that, you know, the processes that piss you off every day, that's where you should start.
00:10:44.339 --> 00:10:45.459
That's the zero to one.
00:10:45.459 --> 00:10:47.779
Get the idea of like what you don't want to do.
00:10:47.779 --> 00:10:53.860
Because eventually, once you get all the stuff out of the air that you don't want to do, the path is gonna light up.
00:10:53.860 --> 00:10:56.659
You'll be like, okay, this is this is the direction we want to take it.
00:10:56.659 --> 00:10:57.699
This is what I want to build.
00:10:57.699 --> 00:11:00.500
And then you bring somebody in to build that or you piss yourself.
00:11:00.899 --> 00:11:08.899
Like I and I'm with you, like the things that I don't like to do, but like to some degree, there's every job right now has things that we don't like to do, right?
00:11:08.899 --> 00:11:21.699
You brought a salesperson, I think in the marketing context, the one that pops to my head is you know cleansing and you know getting lists cleaned up to be able to upload into a marketing automation platform or something like that, right?
00:11:21.699 --> 00:11:24.259
Which is necessary in a lot of cases, right?
00:11:24.259 --> 00:11:26.100
And it's an important piece of work.
00:11:26.100 --> 00:11:31.620
But like I'm sure there's a handful of people out there who actually enjoy that work.
00:11:31.620 --> 00:11:38.419
I'm not one of those, and I would love absolutely love to just replace that in some automated way.
00:11:38.419 --> 00:11:49.939
So I think it feels like there's a little bit of like I what I'm hearing from you is not just like things that annoy you and bother you, but like those that are still important, but are like things you don't enjoy doing.
00:11:49.939 --> 00:11:52.819
Maybe it's a slight, slight tweak from what you were saying.
00:11:53.139 --> 00:12:04.579
Yeah, it's it's uh if you've ever heard of the eisen, I think it's called the Eisenhower matrix, it's uh skill and will, and or it's gonna be something along between is it urgent and important?
00:12:04.579 --> 00:12:12.019
And it wherever it falls on that matrix, if you have to delegate that work, you should automate it.
00:12:12.019 --> 00:12:14.019
You should automate it to the best of your ability.
00:12:14.019 --> 00:12:23.779
You should save a hundred percent, you should save 80% of your brain function to focus on the tasks that are the most important and the most urgent because nobody's gonna be able to replace that, right?
00:12:23.779 --> 00:12:35.779
But if you're how I got into it, very true story is you know, my girlfriend at the time was a virtual assistant, and I was trying to figure out what does a virtual assistant do so that I can work from my laptop.
00:12:35.779 --> 00:12:36.980
That's how it all started.
00:12:36.980 --> 00:12:48.899
And I was like, oh, they, you know, in my silly head, like, you know, you book the calendar meetings, you you keep an eye on the email, you keep an eye on the Slack, you you maybe take a look at the car reservations, you know, you do your job.
00:12:48.899 --> 00:13:00.740
And I was trying to figure out a way, okay, like what if I just got a notification from all of these different platforms in one place at every, you know, all summarized in one place.
00:13:00.740 --> 00:13:03.459
Would it make my job easier as like a person?
00:13:03.459 --> 00:13:06.980
So I built something for my own inbox that that does that for me.
00:13:06.980 --> 00:13:16.419
So um these annoying things, the repetitive aspects, like how many times a day, how many times an hour, how many times a month are you doing it?
00:13:16.419 --> 00:13:19.459
What is the impact that it's gonna have in the short term and the long term?
00:13:19.459 --> 00:13:27.379
I think this is the way that you could start thinking about kind of like going from manual processes, you know, like you just said, like enriching your CRM.
00:13:27.379 --> 00:13:28.819
That is a pain in the butt.
00:13:28.819 --> 00:13:32.019
Um, that is that is something like people come to me for.
00:13:32.019 --> 00:13:37.299
It's like we have 400,000 contact records in HubSpot.
00:13:37.299 --> 00:13:38.819
What do we do with them?
00:13:38.819 --> 00:13:40.259
Oh, there's a strategy.
00:13:40.259 --> 00:13:45.139
Let's go pay for Zoom info, let's go, you know, use HubSpot Breeze to enrich it, right?
00:13:45.139 --> 00:13:47.139
That's like kind of like the whole thing now.
00:13:47.139 --> 00:13:56.019
But to do it in a sequential order and to do it in a way that you can actually get money out of that project is a completely different strategy.
00:13:56.019 --> 00:14:07.299
So I think like before you do any automation, before you do any like thing, you should probably think about the strategy before you do that and how how you might make money back, you know, if that makes any sense.
00:14:07.620 --> 00:14:16.179
Yeah, it's like there's a like uh I mean, I'm people with long time listeners know I'm a big fan of having sort of thinking in the financial terms, right?
00:14:16.179 --> 00:14:17.539
So there's an ROI, right?
00:14:17.539 --> 00:14:22.819
Like whether that investment is a time and effort one or actual dollars, like doesn't really matter.
00:14:22.819 --> 00:14:30.019
It's like are you gonna get more back from that in the long term or whatever time horizon you're looking at, right?
00:14:30.500 --> 00:14:31.220
Exactly.
00:14:31.220 --> 00:14:35.139
It and it and that's not even just talking about I do the same thing.
00:14:35.139 --> 00:14:36.819
It exactly what you just said.
00:14:36.819 --> 00:14:54.259
It it is everything has to be ROI adjusted, whether that's gonna be you're gonna build an automation, you know, somebody comes to me like, oh, what is the, you know, we're gonna pay $10,000, $20,000, $30,000 for something, you know, monetary value, but what is the actual realized ROI?
00:14:54.259 --> 00:15:05.620
Okay, within three months, you're gonna your SDRs are gonna be spending 35% less time because we've timed them, we've looked at their data entry times, we've averaged it.
00:15:05.620 --> 00:15:08.259
That's gonna be like the time that they save.
00:15:08.259 --> 00:15:13.379
But what is the percentage of their salary that you're paying them that's gonna be freed up?
00:15:13.379 --> 00:15:17.779
What is the 35-25% of their salary that they're gonna be able to go and focus and do something else?
00:15:17.779 --> 00:15:19.860
That's your margin, that's your ROI right now.
00:15:19.860 --> 00:15:22.819
And that's how I, you know, that's a whole different story.
00:15:22.819 --> 00:15:24.659
But yeah, I agree completely.
00:15:24.659 --> 00:15:26.899
It's everything needs to tie back to revenue.
00:15:27.139 --> 00:15:27.779
It's interesting.
00:15:27.779 --> 00:15:45.220
The other like the tie back when you bring in other, like now you if you're if you're opening up resources to be able to apply their skills and experience in in ways that are more productive or more uh provide better return for your organization or whatever, right?
00:15:45.220 --> 00:15:49.220
It seems like it's a really good mesh with I don't know if you are you familiar with Strengths Finder.
00:15:50.500 --> 00:15:50.819
No.
00:15:51.220 --> 00:15:54.899
Okay, so this is like one of those personality test kind of things, right?
00:15:54.899 --> 00:16:04.019
But the the real uh the precursor to that book and then the the actual assessment was a book called Um First Break All the Rules.
00:16:04.019 --> 00:16:09.939
And it was kind of a one of the first management books that I read where I was like, oh, they like it actually really changed how I thought about things.
00:16:09.939 --> 00:16:20.579
And the basic premise is a lot of modern um like management was about right uh fixing people's weaknesses, right?
00:16:20.579 --> 00:16:28.500
Uh and this sort of flipped it on its head and said, really, what you should be doing is take advantage of people's strengths and minimize the impact of their weaknesses.
00:16:28.500 --> 00:16:30.659
So like it's not ignoring it.
00:16:30.659 --> 00:16:36.579
But where I'm going is like this meshing of like what do I like what's like what could I get?
00:16:36.579 --> 00:16:49.139
If I if I could free up somebody who's got a strength in a certain area, but they're not able to take advantage of it because they're spending a lot of time on stuff that they don't like, they're not good at, but it's a necessary part of the job, um, you start to free up more of that time.
00:16:49.139 --> 00:16:55.860
Now you can apply that strength to something else where it's a bet going to be a better return and it's probably gonna be more satisfying for them.
00:16:55.860 --> 00:16:59.539
I think this is a really interesting way of thinking about it.
00:16:59.539 --> 00:17:03.059
That like literally in real time, I'm like it's hitting me.
00:17:03.220 --> 00:17:07.220
So uh this is like very common.
00:17:07.220 --> 00:17:24.660
And I know I know we're kind of tangenting, but I I think it's very common when people will come to our door and they'll say, We want to take call intelligence and we want to figure out what competitors are being mentioned.
00:17:24.660 --> 00:17:29.700
Okay, that's that's a whole call intelligence workflow, you know, that has to be built out.
00:17:29.700 --> 00:17:31.460
But why?
00:17:31.460 --> 00:17:36.740
Why would that, you know, like what where where's that revenue gonna be made back?
00:17:36.740 --> 00:17:40.019
What type of insight does that data give you?
00:17:40.019 --> 00:17:41.619
And what are you gonna do with that insight?
00:17:41.619 --> 00:17:42.899
What's the action you're gonna take?
00:17:42.899 --> 00:17:49.700
And and I think being able to steer the course before you start building is very, very important.
00:17:49.700 --> 00:18:03.700
Because uh what I see a lot, and I don't I'm not sure if you see this a lot, is like sales works in their little bubble, and then you've got revenue team and marketing team kind of like sitting over here, and but nobody had nobody actually sees each other's data, and I think it's a huge problem.
00:18:03.700 --> 00:18:21.859
So it's I think it's about when you're starting to think about like making AI workflows and agents and stuff like this inside of a like you know, I work in mid-market, so if you have to connect the teams, you have to make everybody play nice together somehow, and it's not an easy job to do.
00:18:21.859 --> 00:18:26.660
Um, it takes a lot of coordination, but there's a lot of issues with the industry.
00:18:26.660 --> 00:18:31.779
It's that like you just build one thing and call it an AI workflow, and it that's just not what it is, you know.
00:18:32.019 --> 00:18:38.180
Yeah, I think you're hitting on something that really like I think it I've always thought it's important to go like what's the end result?
00:18:38.180 --> 00:18:41.139
Like, what do you want to do with what you're asking?
00:18:41.139 --> 00:18:49.379
Very often how I it pushbacks maybe not the right way, but I I want to understand the why when I like somebody has come to me as a marketing apps leader.
00:18:49.379 --> 00:18:58.180
Um, and I think example I could use is actually before marketing apps was really a thing, but I ran website for a big global semiconductor company.
00:18:58.180 --> 00:19:05.139
And when the product marketers came, he's like, hey, we want to get like we want to get asked, you know, put up a form and ask for feedback from customers.
00:19:05.139 --> 00:19:06.579
Great, easy.
00:19:06.579 --> 00:19:08.420
What are you gonna do with it?
00:19:08.420 --> 00:19:15.059
Because I'm gonna tell you right now, if you open that up and people start providing that feedback, they're gonna want to know what did you do?
00:19:15.059 --> 00:20:17.279
And they hadn't thought through that part of it.
00:20:17.279 --> 00:20:28.879
And I think it feels like that is gonna needs to be even more and more important with these things where they're less deterministic if you're especially automating things, right?
00:20:28.879 --> 00:20:38.480
Where you've got some sort of LLM or AI sort of component in the middle of it where you don't always know exactly what's gonna come out of the other side.
00:20:40.160 --> 00:20:45.839
Yeah, I think um I think that comes down to all, it just comes down to operations.
00:20:45.839 --> 00:20:54.160
And it comes down to processes, it comes down to nailing goes down, it comes down to hey, if you're gonna do one, this second thing is gonna happen.
00:20:54.160 --> 00:20:56.399
If you're gonna do A, B is gonna happen.
00:20:56.399 --> 00:20:59.119
Um, but it's the edge cases.
00:20:59.119 --> 00:21:07.279
Like humans, you know, like we make mistakes, but then we get reprimanded and we're like, oh, we're not gonna make that mistake again.
00:21:07.279 --> 00:21:18.879
But the the the bigger issue that I'm seeing now is that like when you start to replace humans with machines, is how do you make sure that machine handles that edge case a different way the next time?
00:21:18.879 --> 00:21:29.359
And I think like you can tell somebody what to do and they're gonna learn not to shove the circle into the square hole, but a machine doesn't know inherently like what they did wrong.
00:21:29.359 --> 00:21:34.399
So you have to tell it what to do before it does it, before it tries to do that thing, right?
00:21:35.200 --> 00:21:39.759
Yeah, you have to give it it can't be totally free form.
00:21:39.759 --> 00:21:41.359
Yeah, you need to provide it some rules.
00:21:41.359 --> 00:22:06.319
It's interesting because I hadn't really like my own experience, just personal level of using ChatGPT is I've had a lot of several times where I've been frustrated, where I get an output that is say 80 to 90 percent of what I was hoping for, and I give it very specific instructions, go change this or that on the output, and it completely changed, like it does some something completely different, like it actually goes away from where it was going.
00:22:06.319 --> 00:22:20.319
And you know, that's like my fear would be if I'm doing something that's automated and that's like something like that's in the middle of it, that if it like call it an edge case, call it a hallucination, call it whatever, right?
00:22:20.319 --> 00:22:22.559
That's a risk that we have to deal with.
00:22:23.839 --> 00:22:26.319
Yeah, and I I think that's gonna happen anywhere.
00:22:26.319 --> 00:22:34.720
It's you're gonna have that in organizations, you're gonna have that, you know, in in user, you know, a user level, you know, things like that, right?
00:22:34.720 --> 00:22:40.079
Um when I started using GPT, you know, no hate here.
00:22:40.079 --> 00:22:47.599
Like OpenAI did a great job by getting GPT into the hands of the consumers, the consumer market, right?
00:22:47.599 --> 00:22:56.639
But behind the scenes in the organization level, like there's already intelligence layers that are crunching and formulating and you know, like spitting out intelligence and insights.
00:22:56.639 --> 00:23:01.519
Um on the consumer level, I was not a power user at all.
00:23:01.519 --> 00:23:11.599
I was a power user of workflows, I was a power user of like, you know, formulas and API calls and you know, sequences and HubSpot and stuff like this.
00:23:11.599 --> 00:23:13.279
But damn, I hated it.
00:23:13.279 --> 00:23:19.200
I hated the process of like interacting with it because, like you just said, it's like a lot of people get frustrated.
00:23:19.200 --> 00:23:24.399
I was one of those people, you were one of those people, you type something in and it's like, uh-huh.
00:23:24.399 --> 00:23:28.960
I'm gonna go get that thing over there, and it's not anything relevant to what you do.
00:23:28.960 --> 00:23:36.240
And and now it's been like two or three years since we've had like this kind of like this power in our in our hands to be able to tell it what to do.
00:23:36.240 --> 00:23:39.359
And now you can just like you can do so many crazy things.
00:23:39.359 --> 00:23:39.839
Yeah.
00:23:39.839 --> 00:23:43.279
Um but it takes so much precision.
00:23:43.279 --> 00:23:48.399
Like if you want it to do a very specific thing, you need to be super precise about it.
00:23:48.399 --> 00:23:52.639
And and the problem is actually not being able to produce the quality result once.
00:23:52.639 --> 00:23:58.799
Um I feel like on a on a consumer level, the hardest thing to do is to aim for consistency.
00:23:59.359 --> 00:23:59.519
Yeah.
00:24:00.559 --> 00:24:01.359
Can it do it again?
00:24:01.359 --> 00:24:03.599
Can you do it again, basically, right?
00:24:04.319 --> 00:24:21.680
Yeah, yeah, no, it's um I think I heard someone the other day talking about like training in AI on, especially if you're thinking about like for your purposes and like as a it's almost like um teaching a baby, right?
00:24:21.680 --> 00:24:23.680
Because that's kind of where it starts.
00:24:23.680 --> 00:24:28.480
It doesn't really though it could it's just what's weird is it actually speaks your language already, right?
00:24:28.480 --> 00:24:29.759
Which is not what a baby can do.
00:24:29.759 --> 00:24:31.440
So like that's that part's different.
00:24:31.440 --> 00:24:32.960
So it's a very interesting one.
00:24:32.960 --> 00:24:35.359
So uh you kind of hinted at something.
00:24:35.359 --> 00:24:44.240
So one of the other things you and I talked about before was um systems thinking and and how that needs to come into play.
00:24:44.240 --> 00:24:47.359
Um, when you think about AI and adoption of AI.
00:24:47.359 --> 00:24:48.480
Like, what did you like?
00:24:48.480 --> 00:24:49.519
So what did you mean by that?
00:24:49.519 --> 00:24:51.759
Like what like from your from your frame, maybe start.
00:24:51.759 --> 00:24:55.920
Like, what is systems thinking from your perspective and then why you think it's so important?
00:24:56.720 --> 00:25:02.319
So system thinking is imagine you have, I'll just put it very eloquently.
00:25:02.319 --> 00:25:04.639
Imagine you have a car, right?
00:25:04.639 --> 00:25:08.559
And each component of that car makes up the whole machine, right?
00:25:08.559 --> 00:25:12.799
You've got the wheels, you've got the axles, you've got the engine, you've got the motor, like whatever.
00:25:12.799 --> 00:25:17.359
If you take the wheel off the car, can it run?
00:25:17.359 --> 00:25:19.279
Maybe on three wheels.
00:25:19.279 --> 00:25:21.279
Depends on what you mean by run, but yeah.
00:25:21.279 --> 00:25:24.319
Depends on what you mean mean by run, exactly.
00:25:24.319 --> 00:25:34.720
But if you change one thing in a in a s in a machine, if you take that belt out, if you take the engine out, it's probably not going to work as well as you designed it to.
00:25:34.720 --> 00:25:47.359
System thinking is the idea in my head that before you change one component, you should look at the ramifications of the impact across the whole system.
00:25:47.359 --> 00:25:53.359
And you see this a lot in like workflows, especially in like, especially in Zapier, right?
00:25:53.359 --> 00:26:01.359
It's like you've got one Zapier account, you've got 20 folders in there, and you've got 18 different zaps in there that are all floating around.
00:26:01.359 --> 00:26:03.359
Ideally, they're organized.
00:26:03.359 --> 00:26:08.559
If you change one custom field inside of HubSpot, how many of those zaps break?
00:26:08.559 --> 00:26:14.639
If you if one of your interns goes in and breaks one thing, how many of those things get you know jeopardized?
00:26:14.639 --> 00:26:25.039
And I think this idea of like systems thinking and the way that you can approach making a minor impact is that that one thing can domino affect down the whole system and shut it down.
00:26:25.039 --> 00:26:30.160
And I'm sure that has happened to many organizations, you know, but I've seen it.
00:26:30.160 --> 00:26:39.119
Um, but this idea of don't change anything until you're know until you know don't change micro until you understand the macro.
00:26:39.119 --> 00:26:44.399
I think this is the idea, and this is how I try to formulate like what is systems thinking?
00:26:44.399 --> 00:26:58.720
Understanding the whole embodiment of an organization, of a system, not just HubSpot, not just the ad campaign, but the whole creative process, looking at like creating the copy, go, you know, go to Canva, post it on LinkedIn.
00:26:58.720 --> 00:27:01.440
Okay, when you post it on LinkedIn, it's an ad, then you boost it.
00:27:01.440 --> 00:27:02.319
But how do you boost it?
00:27:02.319 --> 00:27:03.680
Do you boost it with a UTM?
00:27:03.680 --> 00:27:05.119
Where does that UTM get picked up?
00:27:05.119 --> 00:27:06.160
Does it go to HubSpot?
00:27:06.160 --> 00:27:07.039
Where does it go?
00:27:07.039 --> 00:27:18.000
You know, like tracing the line back and being able to map out the whole system like a skeleton to be able to see, yeah, if I change this little thing.
00:27:18.000 --> 00:27:20.879
That's how it changes everything, and that's the impact.
00:27:21.200 --> 00:27:21.680
Got it.
00:27:21.680 --> 00:27:30.319
So this goes back, as we had a guest on uh it's probably been a year ago now, who talked kind of taught me about something called the Kinebin framework, which is a Welsh word.
00:27:30.319 --> 00:27:35.279
So it's done it's spelled C-Y-N-E-F-I-N, I think I'm close.
00:27:35.279 --> 00:27:36.879
But it's pronounced very differently.
00:27:36.879 --> 00:27:41.839
Anyway, long story short, like this the it differentiates across different kinds of problems.
00:27:41.839 --> 00:27:46.480
And one is the the one that's most relevant here is complicated versus complex, right?
00:27:46.480 --> 00:27:50.720
And what you described, like in fact, car is a great example of complicated, right?
00:27:50.720 --> 00:27:55.279
Where um if you have enough knowledge and training, you can understand how it all fits together.
00:27:55.279 --> 00:27:59.200
But if there's a problem, you can usually kind of figure out and fix it, right?
00:27:59.200 --> 00:28:03.759
Because it's a singular problem, uh, even if it has downstream effects.
00:28:03.759 --> 00:28:16.399
The difference in a complex one, which is feels like we get into very quickly it uh, but doesn't always like we don't always know the different like when we're going from complicated to complex, is it like you actually can't fully understand it?
00:28:16.399 --> 00:28:26.559
And I think this is where AI starts to come in, where it's like you have one input over here and you change it, you actually don't know what the impact is gonna be in that one case, right?
00:28:26.559 --> 00:28:30.559
And now you start at like you've brought like you got a new case, the input's slightly different.
00:28:30.559 --> 00:28:32.319
Do you get the same kind of result?
00:28:32.319 --> 00:28:33.759
Maybe, maybe not.
00:28:33.759 --> 00:28:43.440
And that's where I suspect we're headed is that we're gonna be moving from complicated, where it's not easy, but you can kind of figure it out to complex.
00:28:43.440 --> 00:28:53.759
Um, and it will be really, really difficult to figure out if something changes and you don't know because it's all sort of uh hidden inside this quote black box.
00:28:56.319 --> 00:28:58.639
Nail that you nailed it.
00:28:58.639 --> 00:28:59.119
Okay.
00:28:59.119 --> 00:28:59.359
Yeah.
00:28:59.680 --> 00:29:03.440
But I mean, but understanding how those pieces fit together is important, right?
00:29:03.440 --> 00:29:05.039
I I like I don't want to discount that.
00:29:05.039 --> 00:29:09.039
Like so that systems thinking I I now that you described, right?
00:29:09.039 --> 00:29:10.480
Yes, it's gonna be really important.
00:29:10.480 --> 00:29:23.920
Um, but it feels like there's gotta be this um acknowledgement that even with systems thinking in this new kind of world we're we're either in or headed towards, like it's hard to tell.
00:29:23.920 --> 00:29:27.359
There's gonna be stuff that is gonna be really hard to figure out.
00:29:27.359 --> 00:29:38.799
Um both to set it up and to like figure out if something doesn't I wouldn't even say broke breaks, but like produces an output we don't expect.
00:29:40.160 --> 00:29:44.480
That and that is probably the hardest part of my job is edge case handling.
00:29:44.480 --> 00:29:51.359
I can I feel confident telling you like I can build a research prompt or I can build a prompt in two or three days, right?
00:29:51.359 --> 00:30:04.960
Like stress test and everything like this, but it is the testing period that I tell people about I said, like, listen, like I could build it, but we're gonna test it for two weeks because I need to monitor the edge cases before I hand that over to you.
00:30:04.960 --> 00:30:15.759
And it's just I think you try to some so many people try to go so fast on burning something or implementing something that they don't do the proper QA, and then you get issues, right?
00:30:15.759 --> 00:30:28.480
And and that's that's the way of the world now where everybody's going so fast, AI is here, it's at your fingertips, and you're like, it's gonna solve everything, you know, like a a brand new cooking pan is not gonna make you a better cook, right?
00:30:28.480 --> 00:30:30.720
But like, but it's gonna help.
00:30:30.720 --> 00:30:37.359
Maybe a sharper knife will help, but it's it's inherently not going to it's not gonna fix the root issue.
00:30:37.359 --> 00:30:48.000
And I think if if a lot of people more people try to figure out you know, root cause analysis, the systems thinking approach, is they will understand that they have a lot different problems than they actually think they do.
00:30:48.319 --> 00:30:53.200
So yeah, I mean, do you so do you think that's one of the big mistakes people make when they're trying to adopt AI?
00:30:53.200 --> 00:31:04.319
They're moving too quickly, they're not like what yes, like one of the biggest red like things, things that kind of call bear traps, maybe like the people you watch out for when they're trying to adopt AI.
00:31:04.960 --> 00:31:19.119
I think when I I don't really get it so much anymore across you know, across my desk, but a few months ago, I mean, even I would say even the past like six months, right?
00:31:19.119 --> 00:31:25.039
What I've noticed is that more and more people that come to me, they know like, okay, we're gonna do something complex.
00:31:25.039 --> 00:31:27.039
Going back to complexity, yeah.
00:31:27.039 --> 00:31:37.359
Um, I want to go, like, for instance, I want to build a Slack bot that connects one community to another community, but also routes into Adio and uses call intelligence and everything like this to make content.
00:31:37.359 --> 00:31:37.759
Whatever.
00:31:37.759 --> 00:31:41.359
That's very complex, and you need different API nodes.
00:31:41.359 --> 00:31:46.399
But I think a lot of people that come and they try to use a new tool.
00:31:46.399 --> 00:31:47.039
Tool.
00:31:47.039 --> 00:31:53.599
They use this like shiny object syndrome where it's like you see AI, they're like, oh my God, like I see all these things on LinkedIn.
00:31:53.599 --> 00:31:55.440
This is like the stemming of the problem.
00:31:55.440 --> 00:32:07.440
Is that they see everybody else doing something just super complex and it looks complex and it looks crazy, and it somewhat sounds like it can solve their problem.
00:32:07.680 --> 00:32:08.240
Right.
00:32:08.720 --> 00:32:13.680
But they don't realize that every problem is unique.
00:32:13.680 --> 00:32:19.200
And I think like that's the very like pinnacle of the problem, like, not even regarding AI adoption.
00:32:19.200 --> 00:32:22.079
I think it's how you how you hire people.
00:32:22.079 --> 00:32:23.359
Like, why are you hiring them?
00:32:23.359 --> 00:32:24.480
Is the problem unique?
00:32:24.480 --> 00:32:26.720
Are you making a workflow or something like this?
00:32:26.720 --> 00:32:42.319
So I think understanding not being able to understand the situation before you try to adopt something like AI and not being able to define the problem properly and not being able to define possible solutions to implement is a huge problem.
00:32:42.319 --> 00:32:49.440
And and I don't I don't touch that because it's it makes work very difficult when you've got a project manager.
00:32:49.440 --> 00:32:55.200
It makes it makes everything slow down and you're like, oh wait, uh-oh, I built something and you didn't want that.
00:32:55.200 --> 00:32:58.799
Everybody's been there, you know, and then it costs everybody time.
00:32:58.799 --> 00:33:18.319
So I think it's rather just slow down, define the problem, define the desired result, work backwards, look up any roadblocks, try to, you know, set up the task matrix, just who's gonna handle what based on their strengths, delegate, start at the beginning, and then say, okay, this is gonna take this much time.
00:33:18.319 --> 00:33:19.599
And then that's done.
00:33:19.599 --> 00:33:24.799
And I think I think companies and people that fail to do this in this order, just bound to fail.
00:33:24.799 --> 00:33:29.039
And I it just it's too fast, not enough thinking, it's just failed.
00:33:29.359 --> 00:33:34.319
It's the whole the whole like to try to eat an elephant in one bite is like doomed to fail, right?
00:33:34.319 --> 00:33:37.759
Um so what I'm curious what your take is.
00:33:37.759 --> 00:33:47.279
I think I think when we talked before, you're switching gears a little bit, is that yeah, a lot I think there's a lot a lot of fear out there that AI is going to replace people.
00:33:47.279 --> 00:33:54.799
And I think if I remember right, your take on it was that AI wasn't gonna replace people, is gonna replace people who didn't know how to use AI.
00:33:54.799 --> 00:33:58.000
Is that has it is that a fair assessment?
00:33:58.000 --> 00:34:00.480
And like has it evolved at all since then?
00:34:01.039 --> 00:34:02.000
Has it evolved?
00:34:02.000 --> 00:34:04.960
It's probably I I'll probably double down on that statement.
00:34:04.960 --> 00:34:15.200
It's we are apex predators as humans because we know how to use tools and because we know how to think ahead.
00:34:15.200 --> 00:34:18.639
That is that is my double-down statement.
00:34:18.639 --> 00:34:25.440
AI is a tool that allows you to do more way past your cognitive abilities.
00:34:25.440 --> 00:34:33.280
I'm not a P, I don't have a PhD in microbiology, I don't have a PhD in you know, mathematics or anything like this.
00:34:33.280 --> 00:34:44.800
But these LLMs that, you know, OpenAI and Propic, and you know, any of the other LLMs out there that are amazing, they've been trained to do this.
00:34:44.800 --> 00:34:59.519
I, you know, they've they've gone through the steps, they've gone through the data, they've there you have you have a billion perspectives and a billion different data points outside of your own cognitive ability to be able to tap into.
00:34:59.519 --> 00:35:02.480
You just need to ask the right questions.
00:35:02.480 --> 00:35:14.160
And I think the people that know how to ask the right questions, the people that are inherently inquisitive about new tools that are, you know, how to become a better prompt engineer, how to use AI better.
00:35:14.160 --> 00:35:15.760
This is step number one.
00:35:15.760 --> 00:35:20.880
It's like, don't ever just use GPT, login and it's gonna say, hey, help me do this.
00:35:20.880 --> 00:35:21.519
No, no, no.
00:35:21.519 --> 00:35:30.240
Go to GPT, open two GPT windows, say, help, I want to do this, write a better prompt for me to help me do this that I can copy and paste.
00:35:30.240 --> 00:35:30.960
Do this.
00:35:30.960 --> 00:35:33.760
It's gonna be way smarter than you about prompting.
00:35:33.760 --> 00:35:55.040
Take that, put it in the second window, do your task, and then after you're done with your tasks, say, This is what I did, this is the prompt I used, this was the original prompt that I wanted to use, but help me learn how to go from my original idea, my original intelligence level through the process and teach me how to do it at a higher standard.
00:35:55.280 --> 00:35:55.600
Yeah.
00:35:55.760 --> 00:36:04.720
And I think like the people that know how to do this are gonna soar over the people that that don't know how to ask the right questions or don't adopt AI.
00:36:04.720 --> 00:36:09.920
The people that just you know don't adopt it, I think it's quite frankly, I think it's negligence.
00:36:09.920 --> 00:36:12.000
And uh it's a tool.
00:36:12.000 --> 00:36:19.600
You don't need to use it to be great at what you do, but I think if you're if you're trying to do more and accelerate, it's clearly the next step.
00:36:19.600 --> 00:36:22.480
And yeah, I saw that's just my my forte, Anna.
00:36:22.880 --> 00:36:27.360
I saw somebody post on LinkedIn, I don't remember, but it was recent, like the last week or two.
00:36:27.360 --> 00:36:32.800
Somebody was saying, like kind of echoes what you're saying, AI is a tool.
00:36:32.800 --> 00:36:41.280
And he's like, as a writer, like my right, like I didn't lose the ability to write when I started going from pen and paper to a typewriter.
00:36:41.280 --> 00:36:44.960
I didn't lose my ability to write when I like from that to a computer to no.
00:36:44.960 --> 00:36:50.240
It's but it's it and it didn't change when I started using grammarly or something like that.
00:36:50.240 --> 00:36:58.240
Like it just helped me get better and more efficient at it, it's as opposed to atrophying, which we we could talk about.
00:36:58.240 --> 00:37:00.320
Like, I I think it's gone by the wayside now.
00:37:00.320 --> 00:37:09.920
There was all those headlines about like AI causes brain atrophy, but I think that was just headline fodder, but I don't know what your take was on that.
00:37:10.240 --> 00:37:11.680
That's the MIT study, right?
00:37:11.680 --> 00:37:12.160
Yeah, yeah.
00:37:12.160 --> 00:37:14.480
The one I was covered a few months ago.
00:37:14.480 --> 00:37:19.200
Yeah, I think uh that's a whole discussion.
00:37:19.200 --> 00:37:29.200
Um but I had read I had read the synopsis of that study uh like a few whenever it came out, a few months after it came out.
00:37:29.200 --> 00:37:42.880
Um for the people that didn't read it, it was like a study by MIT with a control group, and it was it was it was roughly talking about like people that use AI and the people that don't use AI and kind of like the adoption and the competence levels there.
00:37:42.880 --> 00:37:54.720
Um, but roughly uh the synopsis there that I would sum up is that the way that it was presented in the news that like GPT users have you know lower competence of like XYZ.
00:37:54.720 --> 00:38:21.200
Um that's canon fodder, but I would say that there was like my personal beliefs aligned with that article in the sense that somewhere in there it said something along the lines of like higher competence users of AI will lapse lower competence users at a baseline level, but lower competence users will fail to learn if they continue at this pace of low learning like aptitude.
00:38:21.200 --> 00:38:32.080
Yeah, long story short, lazy people get lazier because they depend on AI as a shortcut, but the higher performers, the ones that are more inquisitive, will use that as an acceleration jump in their learning.
00:38:32.080 --> 00:38:34.480
So it's that's how I understood it.
00:38:34.640 --> 00:38:35.120
Yeah.
00:38:35.120 --> 00:38:36.720
Yeah, I'm with you.
00:38:36.720 --> 00:39:01.120
And I it it's consistent with other stuff I've heard uh more in the education realm, um, where the highest performing kids who started using AI as a part of their learning process continue to like distance themselves and those that didn't use it, and and those who who were not performing as well and used it also improved.
00:39:01.120 --> 00:39:03.200
They just their improvement was less, right?
00:39:03.200 --> 00:39:07.040
So it's not quite what you were saying, but it's very similar kind of results.
00:39:07.040 --> 00:39:08.880
Um I'm sure there's studies there.
00:39:08.880 --> 00:39:11.680
I just I that one I've heard just anecdotally about.
00:39:11.680 --> 00:39:17.600
Um okay, so I'm trying to decide where to go here.
00:39:17.600 --> 00:39:23.360
So you we kind of talked about the system prompt, you know, like using the tool to help you write better prompts.
00:39:23.360 --> 00:39:33.360
And um one of the things you you and I talked about, and I still feel like I don't quite understand, is the difference between I think you called it a system prompt and a user prompt.
00:39:33.360 --> 00:39:37.440
Like so is this well, I'll I'll let you explain.
00:39:37.440 --> 00:39:38.480
What's the difference?
00:39:38.800 --> 00:39:49.280
Yeah, so in in the context of a user-level interaction, this is it layman's term, you log onto your computer on your phone and you type in the GPT.
00:39:49.280 --> 00:39:50.320
You're the user.
00:39:50.640 --> 00:39:51.040
Yeah.
00:39:51.440 --> 00:39:58.480
On the system side, that is inherently going to be how the system thinks, right?
00:39:58.480 --> 00:40:00.560
It's going to be a blank slate.
00:40:00.560 --> 00:40:06.160
You know, like imagine you as a human, just in a machine form, right?
00:40:06.160 --> 00:40:10.720
You're a system as a person, your brain is a system, it's wired to think a specific way.
00:40:10.720 --> 00:40:12.240
Your brain, it's wired.
00:40:12.240 --> 00:40:18.400
You've learned all these different interactions, you know how to speak, maybe French, Italian, Spanish, English, whatever.
00:40:18.400 --> 00:40:24.160
Maybe you have a maybe you have a doctorate, maybe you have you're in a bachelor's degree of engineering, maybe you're in business.
00:40:24.160 --> 00:40:29.840
You have all of these unique different ways of connecting the synapses, right, in your brain.
00:40:29.840 --> 00:40:31.280
Everybody is unique.
00:40:31.280 --> 00:40:33.280
That's what makes us us.
00:40:33.280 --> 00:40:35.200
But we're not a machine.
00:40:35.200 --> 00:40:42.400
And if you want to replicate the way of thinking, like a machine, this machine thinking, quote unquote, right?
00:40:42.400 --> 00:40:44.000
I'm gonna kind of like simplify.
00:40:44.000 --> 00:40:49.680
A system prompt is the back-end design of what you're talking to.
00:40:49.680 --> 00:40:56.880
A user prompt is what you're actually talking, like how you're interacting with the machine, if that makes sense.
00:40:56.880 --> 00:41:04.240
So when you put in, hey, help me make do this research, you are prompting it as a user.
00:41:04.240 --> 00:41:07.680
But you are prompting it as a user and not a machine.
00:41:07.680 --> 00:41:12.720
The machine, the system, will think in a very specific way.
00:41:12.720 --> 00:41:14.960
And and it's trained to do this.
00:41:14.960 --> 00:41:22.080
So you have very specific use cases like I want you to act like a market researcher.
00:41:22.080 --> 00:41:28.880
I want you to tell me how to make a podcast episode, but have you ever given it extra pot like context right before you tell it what to do?
00:41:28.880 --> 00:41:30.640
Like, hey, I I want you.
00:41:30.640 --> 00:41:33.280
This is contextual prompt prompting.
00:41:33.440 --> 00:41:33.760
Yes.
00:41:34.000 --> 00:41:37.280
The system prompt is behind the scenes.
00:41:37.280 --> 00:41:42.480
So you can already give it all of the intelligence and all of the use cases.
00:41:42.480 --> 00:41:47.680
You can fuse shot it, you can give it edge cases to look out for, you can tell it what to think.
00:41:47.680 --> 00:41:58.320
So not a lot of models will, well, nowadays you can, but not a lot of models six, seven, eight months ago made it easy for you to actually design the system prompt.
00:41:58.320 --> 00:42:03.040
You were only able to interact with it from a user prompt point of view.
00:42:03.040 --> 00:42:11.360
So when you are building a workflow, you know, maybe you there's some listeners that, you know, understand API calls and stuff like this.
00:42:11.360 --> 00:42:20.080
If you have the chance to put information inside of a system prompt window, this is where you're going to give it its thinking ability.
00:42:20.080 --> 00:42:21.760
This is where you're going to give it full context.
00:42:21.760 --> 00:42:25.360
This is how you're going to give it all of its edge cases, its limitations, and everything like this.
00:42:25.360 --> 00:42:30.800
The user prompt is to drive the conversation and the contextual output forward.
00:42:30.800 --> 00:42:32.480
So these are the two differences.
00:42:32.480 --> 00:42:40.000
And I think like when you are, you know, you're just in your computer or you're on your phone and you're just trying to like find the answer to something, you're prompting it.
00:42:40.000 --> 00:42:41.440
You've not designed it.
00:42:41.600 --> 00:42:41.840
Right.
00:42:42.080 --> 00:42:51.840
The first iterations of a system prompt came with like a fine-tuned LLM where you would kind of design it to you know handle these use cases to think in a specific way.
00:42:51.840 --> 00:42:53.120
It's not thinking.
00:42:53.120 --> 00:42:57.519
I mean, it is, but it's connecting synapses, it's connecting nodes of data together.
00:42:57.519 --> 00:42:58.720
That's thinking.
00:42:58.720 --> 00:43:03.200
That's a system prompt and I think those are two inherently different things that you can.
00:43:06.240 --> 00:43:14.160
I was thinking like programming languages like that most people would use versus assembly language, but I don't think it's quite the right analogy there, right?
00:43:14.160 --> 00:43:35.040
This is like um, if I understand it right, it's almost like um providing that baby, right, um as much ex like experiential stuff you can, right, and knowledge before you then go ask it to go either answer something or do something or whatever, right?
00:43:35.040 --> 00:43:37.360
Is that the way more of a better way of thinking about it?
00:43:37.519 --> 00:43:37.760
Yes.
00:43:38.000 --> 00:43:42.800
I I would I would up the complexity a little bit, but on a on a back end, yes.
00:43:42.800 --> 00:43:54.960
Uh imagine like you have that one friend that's really annoying that you just don't want to like talk to about anything, but you know that if you tell him about this other thing, that he's gonna be there for you or XYZ, right?
00:43:54.960 --> 00:43:56.720
This is like a very complicated scenario.
00:43:56.720 --> 00:44:03.360
But the system, that person is a system, and they're gonna handle stimuli in a very specific way.
00:44:03.360 --> 00:44:06.400
When X occurs, that's gonna happen, right?
00:44:06.400 --> 00:44:13.360
Because it's you've already tried to talk to that guy about you know, 20 times, you know, two in the morning comes over, whatever, you know.
00:44:13.360 --> 00:44:22.960
Yeah, but the way the the consistency, like the training of this, that's that is like the personality, that is the way that the system operates.
00:44:22.960 --> 00:44:28.480
It's the operating model, it's not like assembly, but the user input is the scenario.
00:44:28.480 --> 00:44:37.600
So instead of instead of looking at it as like, oh, the you know, like you're gonna give the toy to the baby and it's gonna try to shove it through the box, whatever, right?
00:44:37.600 --> 00:44:42.560
You teach it, you tell you tell it what to do and how to do it.
00:44:42.560 --> 00:44:45.040
And when it doesn't do that, these things happen.
00:44:45.040 --> 00:44:46.400
That's a system prompt.
00:44:46.400 --> 00:45:02.800
And then when the scenario happens, when you when you kind of give it the scenario in the context of like what's going on at the user level, then it'll know inherently, oh, this scenario matches scenario 47 that I already have knowledge base about.
00:45:02.800 --> 00:45:04.960
Let me handle it in this specific way.
00:45:05.519 --> 00:45:06.160
Interesting.
00:45:06.160 --> 00:45:06.640
Okay.
00:45:06.640 --> 00:45:10.480
Yeah, I think I'm I'm getting that nuance now a little better.
00:45:10.480 --> 00:45:15.280
So um I think I brought I mentioned the word hallucination at some point.
00:45:15.280 --> 00:45:21.519
Um, and I think pretty much anybody who's used this stuff has experienced a hallucination from one of these LOMs.
00:45:21.519 --> 00:45:35.440
But um so one of the things you and I talked about, you said that you suggest there's like five things that you suggest that you do with every LLM every time you try to go through something.
00:45:35.440 --> 00:45:39.680
I don't know if this is a system prop or user promp, so maybe there's a different shade there.
00:45:39.680 --> 00:45:45.840
But what are those five things uh um that we our listeners or audience could benefit from?
00:45:46.400 --> 00:45:51.440
There are I'm gonna explain it terribly, but I'll do my best.
00:45:51.440 --> 00:46:01.519
Um I always get it context, background, goals, constraints or limitations, and formats.
00:46:01.519 --> 00:46:12.560
So if you can give it those five things, and in not it doesn't have to be in that order, but and you can look up on the OpenAI website and Anthropic COD website, like how to make a good system from, how to make a use good user prompt.
00:46:12.560 --> 00:46:24.000
But if you give it context, you know, you are this, you have this data set, you you know, you're connected to the API and FBI, whatever, you've got all that data.
00:46:24.000 --> 00:46:25.120
That's context.
00:46:25.120 --> 00:46:29.840
Background, you've handled a hundred and a hundred thousand iterations.
00:46:29.840 --> 00:46:33.040
These are the a hundred thousand results that you got that you produced.
00:46:33.040 --> 00:46:36.800
Out of these a hundred thousand, only 50,000 of them should be produced, whatever, right?
00:46:36.800 --> 00:46:39.840
That's that's gonna be the background of like, what is it?
00:46:39.840 --> 00:46:42.720
I'm a senior marketer research, everything like this.
00:46:42.720 --> 00:46:43.920
That's step two.
00:46:43.920 --> 00:46:45.760
So context and background.
00:46:45.760 --> 00:46:47.680
The third one is gonna be the goals.
00:46:47.680 --> 00:46:49.600
So it's gonna be the directed output.
00:46:49.600 --> 00:46:50.800
What are you trying to achieve?
00:46:50.800 --> 00:46:52.800
Okay, I'm a market researcher.
00:46:52.800 --> 00:47:02.560
I have act, I now I have access to Google, I have access to web search capabilities, I have access to NPI, you know, all of these different web pages, whatever.
00:47:02.560 --> 00:47:05.680
But now my goal is to be able to crunch data.
00:47:05.680 --> 00:47:12.480
I want to analyze the data, I want to synthesize the data, I want to triangulate the data sources, I want to see if there are any data discrepancies.
00:47:12.480 --> 00:47:14.080
Okay, awesome.
00:47:14.080 --> 00:47:15.519
Now the fourth step.
00:47:15.519 --> 00:47:17.600
Now we have context, background, and goals.
00:47:17.600 --> 00:47:19.920
Very clear the system knows what to do.
00:47:19.920 --> 00:47:22.160
Then you have limitations or constraints.
00:47:22.160 --> 00:47:23.280
This is the fourth one.
00:47:23.280 --> 00:47:30.400
This is like what a lot of people forget, and this is leading into the discussion of like hallucinations, you what not to do.
00:47:30.400 --> 00:47:34.320
Because you you summed it up perfectly.
00:47:34.320 --> 00:47:40.480
You aren't on a GPT months ago and you were super frustrated because it produced something completely different.
00:47:40.640 --> 00:47:40.800
Yeah.
00:47:40.960 --> 00:47:43.920
What you had forgotten, what you had forgotten, exactly.
00:47:43.920 --> 00:47:51.200
You had forgotten, and naturally I have too many times, is you didn't tell it to retain its memory.
00:47:51.200 --> 00:47:55.840
You didn't tell you told it, you're like, hey, I want you to make these changes.
00:47:55.840 --> 00:48:02.320
But then it did, hey, I'm gonna make these changes across the whole thing.
00:48:02.320 --> 00:48:07.360
But you didn't, you but what would have been better is hey, great job.
00:48:07.360 --> 00:48:09.760
Give it feedback, just talk to it like a person.
00:48:09.760 --> 00:48:10.560
This is what I do.
00:48:10.560 --> 00:48:14.160
I do Windows key H on my keyboard, or you open up speak to type.
00:48:14.160 --> 00:48:16.160
There's a lot of speech to type paths, and I speak to it.
00:48:16.160 --> 00:48:17.040
I give it feedback.
00:48:17.040 --> 00:48:29.440
That's how I work, but with the limitations, do not do this, do not output a string, do not output an array, output rich text or you know, take out all the spaces, take out all the vowels.
00:48:29.440 --> 00:48:36.880
I don't know why you do that, but do not do this, do not list it down because it's not gonna know unless you tell it.
00:48:36.880 --> 00:48:45.040
A child isn't gonna know that the the letter of the alphabet starts with A unless you go A, B, C, D, you know, right?
00:48:45.040 --> 00:48:49.040
So you have to tell it, you have to treat it like a child, right?
00:48:49.040 --> 00:48:50.000
It doesn't know.
00:48:50.000 --> 00:48:55.600
They're so smart now that most of them do, but if it's never seen the scenario before, then it's not gonna know, right?
00:48:55.600 --> 00:48:58.800
So now we have context, background, goals, limitations.
00:48:58.800 --> 00:49:03.280
Now you have the fifth one, which is almost the most important, which is the format.
00:49:03.280 --> 00:49:07.760
So a lot of the form the formation of the output is the result.
00:49:07.760 --> 00:49:10.640
That's the thing that you need to get ROI from, right?
00:49:10.640 --> 00:49:16.080
Like if you're making a workflow or a program or transformation program, that's probably what you care the most about as a result.
00:49:16.080 --> 00:49:20.160
The result doesn't matter if it's not formatted properly.
00:49:20.160 --> 00:49:32.640
If you go into HubSpot and you have a first name field and it says Spencer Tahill dot whatever, but it's it's not spaced out and it's my full name, it's not parsed correctly.
00:49:32.640 --> 00:49:34.080
Like, what's the point?
00:49:34.080 --> 00:49:39.200
You need to do output and then format the output in a way that makes sense.
00:49:39.200 --> 00:49:56.480
I'm a senior researcher, don't do researching about this, don't take X threads, don't look at social media, but I want you to make the result in an array or like in a summary, a one-page summary in this format executive summary, sources used, exclamations, data discrepancies.
00:49:56.480 --> 00:49:57.519
That's the format.
00:49:57.519 --> 00:50:03.200
And that's if you can nail that, you've pretty much got a great prompt on your hand.
00:50:03.360 --> 00:50:03.519
Yeah.
00:50:03.760 --> 00:50:06.560
Context, background, goals, limitations, format.
00:50:06.560 --> 00:50:07.680
And you're pretty much good.
00:50:07.680 --> 00:50:10.320
Outside of that, you can do all of your learning on Open AI.
00:50:10.320 --> 00:50:11.840
Yeah, I think I I won't.
00:50:12.160 --> 00:50:13.360
Yes, yes, yes.
00:50:13.360 --> 00:50:20.560
I think that constraints one was the one that was the biggest help for me when we talked because I started go like to write the elucidations come from that.
00:50:20.560 --> 00:50:38.000
And I started doing things like, you know, only use the stuff that I have provided you specifically for this task, and don't use the other resources because otherwise that's where that's where I found that it was finding stuff it had access to, but wasn't really relevant.
00:50:38.000 --> 00:50:41.360
Um yeah, I think that's that was helpful.
00:50:41.360 --> 00:50:43.840
I still I I had already started doing the context.
00:50:43.840 --> 00:50:45.600
I think the the big thing I've learned.
00:50:45.600 --> 00:50:55.519
So I've got some things where I've got long threads of things where I've provided a whole bunch of context and examples of other up with it I've done to give it guidance, and it was really good.
00:50:55.519 --> 00:50:56.720
It's gotten better over time.
00:50:56.720 --> 00:51:01.840
But what's happened is it's all in one big long chat, and the performance has been bad.
00:51:01.840 --> 00:51:03.600
So I actually did kind of what you said.
00:51:03.600 --> 00:51:05.920
I was like, I'm gonna go ask again.
00:51:05.920 --> 00:51:09.200
I'm not advocating for Chat GPT, it's the one I happen to use.
00:51:09.200 --> 00:51:16.560
Um, and in fact, I feel like I should like I there's a part of me is like I should be looking at others more, but I like I've invested in this one.
00:51:16.560 --> 00:51:23.840
But I actually said, like, I'm having this, like the results are good, the performance isn't is getting worse and worse every time I use it.
00:51:23.840 --> 00:51:25.920
How should I restructure this?
00:51:25.920 --> 00:51:27.840
Like in if I'm gonna do it again.
00:51:27.840 --> 00:51:33.600
And it gave me a great like we went back and forth, and it gave me it actually gave me like here's the structure do this, do this, do this.
00:51:33.600 --> 00:51:37.120
And um that's how I'm gonna implement it in the future.
00:51:37.120 --> 00:51:41.680
So I get the benefit of all that, but continued better performance.
00:51:41.680 --> 00:51:43.680
So yeah, I love it.
00:51:43.680 --> 00:51:48.720
That idea of using the tool to help you get better at using the tool.
00:51:48.960 --> 00:51:51.840
That's that's how I learned.
00:51:52.080 --> 00:51:52.560
Yeah.
00:51:53.440 --> 00:51:57.920
I sucked at it and I got better at it.
00:51:57.920 --> 00:52:03.120
The first step of being great is sucking, unfortunately.
00:52:03.840 --> 00:52:04.400
Yeah.
00:52:04.400 --> 00:52:07.040
Um, well, this has been awesome, Spencer.
00:52:07.040 --> 00:52:08.240
Thanks for for this.
00:52:08.240 --> 00:52:19.920
Um, if folks want to kind of keep continue the conversation with you or learn more about what you're doing or what you're doing with uh with Growth Alliance, what's the best way for them to do that?
00:52:20.400 --> 00:52:24.080
Um guys, anybody that's listening, book a call with me.
00:52:24.080 --> 00:52:27.280
It's uh or text me on LinkedIn, you know, whichever.
00:52:27.280 --> 00:52:29.200
Um I'm completely open.
00:52:29.200 --> 00:52:33.040
My you know, my eyes can be your eyes in the industry.
00:52:33.040 --> 00:52:35.120
Um building a lot of complex things.
00:52:35.120 --> 00:52:36.400
It takes a lot of time.
00:52:36.400 --> 00:52:38.720
So networking chat, dude.
00:52:38.720 --> 00:52:45.760
Like uh book a time on my calendar, tell them that Michael Hartman sent you from marketing ops, and we'll just catch up.
00:52:45.760 --> 00:52:46.640
We'll just get a coffee.
00:52:46.640 --> 00:52:47.600
I like meeting people.
00:52:47.600 --> 00:52:50.000
So um everything is on my LinkedIn.
00:52:50.000 --> 00:52:52.960
It's just like slash Spencer Tahoe on LinkedIn or something like that.
00:52:52.960 --> 00:52:53.440
Gotcha.
00:52:53.440 --> 00:53:00.160
Um, but yeah, don't think that you're alone in trying to learn a new thing because I sucked at it too.
00:53:00.160 --> 00:53:01.280
So it's okay.
00:53:01.600 --> 00:53:08.480
Yeah, no, like I've it's definitely been a like you have to invest a ton, right?
00:53:08.480 --> 00:53:14.240
And it's I wish I had more, but it's it's been I feel like I've gotten better and better over time.
00:53:14.240 --> 00:53:17.920
So yeah.
00:53:17.920 --> 00:53:19.920
Anyway, well, it's a pleasure, Spencer.
00:53:19.920 --> 00:53:20.560
Thank you so much.
00:53:20.560 --> 00:53:21.840
Thanks for staying up late.
00:53:21.840 --> 00:53:25.200
Uh I I know this was a long time coming, so I appreciate it.
00:53:25.200 --> 00:53:28.880
Thanks also to our our listeners and our rest of our audience.
00:53:28.880 --> 00:53:30.160
Uh, we always appreciate you.
00:53:30.160 --> 00:53:37.200
If you have suggestions for topics or guests, or you want to be a guest, you can reach out to Naomi, Mike, or me, and we'd be happy to get the ball rolling.
00:53:37.200 --> 00:53:38.880
Until next time, bye everybody.