WEBVTT
00:00:04.008 -->
00:00:10.971All right, everybody, welcome to the SNEA Experts on Data podcast, and we've got an exciting day today because it's launch day.
00:00:10.971 -->
00:00:17.332It's a big announcement and one that I think that is both surprising and not surprising.
00:00:17.332 -->
00:00:32.814We've seen a lot of buzz around the subject and really what is most important is why we need to go back to the foundation and really revisit this from the bottom up and really think about what is the net effect.
00:00:32.814 -->
00:00:40.271So we're going to get jumping right to the fun part, and I'm very happy to be joined here by Jay Metz, of course, for peaks that are brand new to me.
00:00:40.271 -->
00:00:41.460My name is Eric Wright.
00:00:41.460 -->
00:00:44.628I'm the co-host of the SNE Experts on Data podcast.
00:00:44.628 -->
00:00:51.356So, jay, let's jump in and let's talk about storageai, which is super cool.
00:00:51.356 -->
00:00:53.680It is.
00:00:53.680 -->
00:00:54.442Tell me what it is.
00:00:54.442 -->
00:00:55.886When in doubt, we always have to start the.
00:00:55.886 -->
00:00:59.093So what exactly is storageai?
00:01:00.780 -->
00:01:01.341Storageai.
00:01:01.341 -->
00:01:02.723I love this conversation.
00:01:02.723 -->
00:01:10.234It's one of the greatest things about what I do is I get the chance this is the fun part of my job which I get to talk about the really new, cool things that we're doing.
00:01:10.234 -->
00:01:23.674One of the things that has been an interesting development over the last couple of years, as anybody knows, is the fun, fancy stuff we can do with AI.
00:01:23.674 -->
00:01:30.903You know, making AI videos, making AI music all that kind of stuff is fun on the user side, On the back end.
00:01:30.903 -->
00:01:39.111It's a little less fun On the back end of being able to create stuff where you have to create the videos and make people happy.
00:01:40.040 -->
00:01:43.671The underlying architecture is not quite so straightforward.
00:01:43.671 -->
00:01:52.254As a matter of fact, one of the biggest problems we have in the AI world is getting information into the places where they need to be.
00:01:52.254 -->
00:01:54.484So what storageai is?
00:01:54.484 -->
00:01:55.528It's a way of doing that.
00:01:55.528 -->
00:02:12.850It's a way of getting all that data into the processors and getting them into the right places at the right time for the right moment, into the right places at the right time for the right moment, and so what we're looking to do is have an open ecosystem for being able to have all the different companies that are working on these problems.
00:02:12.850 -->
00:02:27.332Come together, talk it all over, have a solution that everybody can sign on board with and effectively make things life more efficient and more useful, quite frankly.
00:02:27.332 -->
00:02:47.881But ultimately, what we're looking to do is we're trying to create a nice, ubiquitous solution for getting data to where it needs to be at the right time for the AI workload, and that is not as easy as it sounds and certainly wasn't as easy as just saying it out loud it out loud.
00:02:47.901 -->
00:02:50.004Yeah, it's always interesting because we see there's a ton of early innovation.
00:02:50.004 -->
00:02:51.967That's obviously it drips off the tongues of us now.
00:02:51.967 -->
00:03:00.432We refer to so many different companies and brands that if you talked about five years ago, no one on the street would even know who they are.
00:03:00.432 -->
00:03:05.491But now it is really kind of like ubiquitous and part of what we do every day.
00:03:05.491 -->
00:03:06.862But it is funny.
00:03:06.862 -->
00:03:10.493I think, that the industry got there way before.
00:03:10.493 -->
00:03:31.967A lot of the vendors and the platforms hardware, software, cloud, et cetera that are going to be running this stuff and looking at how SNEA has always been so important in really getting, I'll say, a cooperative way of doing it.
00:03:31.967 -->
00:03:35.169It's cooperative but it's also competition.
00:03:35.169 -->
00:03:48.502It's an interesting thing because these are folks that are industry competitors but we come together as a community because we all move faster when we move towards and with a standard.
00:03:48.502 -->
00:03:58.626So you know, looking at AI in general, how have you found where it is in the world versus where it is in?
00:03:58.626 -->
00:04:01.793You know where the standards bodies are coming to the fore now.
00:04:02.841 -->
00:04:03.663Yeah, let's do that.
00:04:03.663 -->
00:04:06.643Let's take a step back and realize what the stuff really is.
00:04:06.643 -->
00:04:15.127Right, because the problem is that if you don't already know the problem, you're not going to be able to understand why this is a big deal.
00:04:15.127 -->
00:04:23.942Okay and realistically, no one individual can have a good scope of understanding of all the different things that are going on.
00:04:23.942 -->
00:04:41.930And when we talk about industry standards or the organizations or the companies that are putting all this stuff together, it's all very nice fluff, but the reality is that there are problems and the problem, one of the biggest problems is that the understanding of the problem is a problem in and of itself.
00:04:41.930 -->
00:04:54.947So, if you talk about an AI workload for those people who don't really understand the AI workload, they don't know that it's not actually one giant monolithic workload right, it's not one thing, it's not like you're.
00:04:54.947 -->
00:05:02.408If you're talking about your laptop, it's not Microsoft Word, right, it's not Mail.
00:05:02.408 -->
00:05:05.072It's not Outlook, it's not your web browser.
00:05:05.072 -->
00:05:07.884That's an application, that's a workload.
00:05:08.545 -->
00:05:18.132When we talk about the workload for AI, it's considerably more complex and it actually winds up being a series of workloads and it's not this one big thing.
00:05:18.132 -->
00:05:36.365If you're talking about training, or if you're talking about inference, it's broken up into multiple different workloads, and the problem is is that getting the data where you need it to be means that sometimes you have to do it in certain ways, and sometimes it's in different formats, and sometimes it's in different structures and different locations and it's complicated.
00:05:36.365 -->
00:05:45.990And then you zoom in even further and you start to realize well, dang man, that's a hard thing to get from point A to point B without going through X, y and Z, right?
00:05:45.990 -->
00:05:48.033Oh, I'm sorry, you're Canadian X, y and Z.
00:05:48.033 -->
00:06:03.627So the issue here is that when you break it down and say I need to get the data from here to here, because it then has to go from there to there and there to there and there to there before you could ever start doing the work, and that's the thing that people don't normally get.
00:06:03.627 -->
00:06:06.562There's no one way to do that.
00:06:06.562 -->
00:06:18.274There's a thousand ways of doing that, and they're all unique, oftentimes they're proprietary, they're all difficult and it's getting to be overburdensome, right?
00:06:18.274 -->
00:06:35.826So when we talk about the stuff, what we're trying to say is like how do we line up the dots, how do we make sure that we're not doing all these detours for every single thing that has to go along the line when we start talking about AI, because they'll talk about GPUs until the cows come home, right, they'll talk about networks.
00:06:35.961 -->
00:06:36.958I talk about networks, right?
00:06:36.958 -->
00:06:45.920We talk about all these things that are component parts of the architecture as if it's this nice compressed box and all you have to do is make the box really nice and efficient.
00:06:45.920 -->
00:06:47.665It doesn't work that way.
00:06:47.665 -->
00:06:49.670That's not what winds up happening.
00:06:49.670 -->
00:06:52.002So let me just give you an example.
00:06:52.702 -->
00:07:02.651I need to have a GPU have the data process, but the problem is that the GPU doesn't talk the same language as the data that's stored on a drive let's just say it's on an NVMe drive.
00:07:02.651 -->
00:07:08.927I have to convert that data into a method or to a structure that the GPU can use.
00:07:08.927 -->
00:07:13.524Ah, but it's not just that the GPU doesn't have a direct connection into that data.
00:07:13.524 -->
00:07:18.221It's got to go through a CPU, and that's assuming that you've got it locally on side of a server.
00:07:18.221 -->
00:07:19.942What if it's not locally on side of a server?
00:07:19.942 -->
00:07:33.596You got to go through a CPU, then out through a network interface card, then out of network into another network interface card and then another storage unit, oftentimes object or file or something along those lines.
00:07:33.596 -->
00:07:38.892So you've got a control plane and a data plane just to start the communication in the first place.
00:07:38.892 -->
00:07:48.329And, depending upon where you are in the process, you could be doing a lot of reading, you could do a lot of writing, it could be sequential, it could be random, it's not all the same all the time.
00:07:48.329 -->
00:07:57.274And so you have these multiple personality disorders that are going on inside of a server with these different processors and the networks and the storage.
00:07:58.060 -->
00:08:03.372And orchestrating this stuff is non-trivial, right, excuse me.
00:08:03.372 -->
00:08:09.706So what we're trying to do here is saying look, how do we get this to work properly in the first place?
00:08:09.706 -->
00:08:10.307That's number one.
00:08:10.307 -->
00:08:16.153Number two how do we catalog all this stuff to make sure we understand exactly where the inefficiencies are?
00:08:16.153 -->
00:08:22.211That's also non-trivial because I could do some of the processing in a cpu to make sure that I get everything where it's going.
00:08:22.211 -->
00:08:25.444I can move some of that into a dpu on the network side.
00:08:25.444 -->
00:08:27.569So now I've got to split that processing.
00:08:27.569 -->
00:08:29.192Just through the work.
00:08:29.192 -->
00:08:35.793I could offload things into other accelerators for memory movement and so on and so forth.
00:08:36.900 -->
00:08:43.043And that becomes really problematic because as you start to increase in scale, you have other problems.
00:08:43.043 -->
00:08:50.034You have to deal with Power Big problem, right, they're talking about creating nuclear power plants just to run AI.
00:08:50.034 -->
00:09:01.269When you're talking about that much power, to be able to run a workload, a single workload, you have to make sure that it is as efficient as you possibly can get, because that's a lot of power, right.
00:09:01.269 -->
00:09:03.746One watt in power per CPU up to a million nodes is a big deal.
00:09:03.746 -->
00:09:04.529That's a million watts of power, right.
00:09:04.529 -->
00:09:06.639One watt in power per CPU up to a million nodes is a big deal.
00:09:06.639 -->
00:09:08.825That's a million watts of power, right.
00:09:09.326 -->
00:09:11.831But what happens when we yeah, exactly what happens?
00:09:11.831 -->
00:09:18.461If we need to you know we need to to figure out what happens at scale when it comes to errors, right?
00:09:18.461 -->
00:09:25.909So one of the things that's really noticeable is that the bigger you go, the more inevitable it is to have failures.
00:09:25.909 -->
00:09:28.447That's why we do checkpointing, right?
00:09:28.447 -->
00:09:34.808There's so many errors in a normal system at that scale that people will have to checkpoint on a very frequent basis.
00:09:34.889 -->
00:09:49.027Well, if you're checkpointing those very expensive processors which can run up to like 50,000 a piece, and you're talking about thousands, tens of thousands and even hundreds of thousands of these things, that's an expensive proposition if they're not actually being used, right?
00:09:49.027 -->
00:09:53.532So if they're waiting for all of this movement to go happen before they can actually get started.
00:09:53.532 -->
00:10:04.145That's an efficiency, that's a waste of effort, it's a waste of time, it's a waste of energy and it increases the likelihood of error before you actually get to a completed workflow.
00:10:04.145 -->
00:10:06.553So these are the problems that we're trying to solve, and there's no one way to do it.
00:10:06.553 -->
00:10:16.754Everybody's got an idea of the way that it should be done, but not a way of making sure that everybody's playing by the same rules so that you can take a single plug and plug it in and know that it's going to work.
00:10:17.275 -->
00:10:22.304What we're doing at SNIA is trying to accomplish the really Herculean task of saying you know what.
00:10:22.304 -->
00:10:55.809It's very important that we all get together and have a good conversation about what's actually required and how we need to solve these problems, because sometimes I need to move memory, sometimes I need to have the access to the data from the GPU or a TPU, sometimes I need to have good communication over the network, sometimes I need to be able to have direct access from one memory to another memory location, and so on and so forth, and you have to be able to have a lingua franca to be able to have the conversation, and that's what we're looking to do, and that's where we're tapping into the enthusiasm of a lot of different companies right now.
00:10:55.809 -->
00:10:58.726Wow, that's a long way of saying what the problem is.
00:10:59.208 -->
00:11:13.458Yeah, well, that's exactly why this is so important, because just even in there, we could unpack 10 podcasts just out of that section of challenges.
00:11:13.458 -->
00:11:13.700And we will.
00:11:13.700 -->
00:11:14.660Well, that's it.
00:11:14.660 -->
00:11:15.241That's the beauty part.
00:11:15.241 -->
00:11:28.626You know, thinking about just you, would you always imagine that we're just going to assume that someone else is handling that next thing, like, oh, we've got data movers that are already happening at the controller layer, where they've got CPU and OS optimizations.
00:11:28.626 -->
00:11:36.827You're like, yes, but that's for a particular type of workload that doesn't act the way the software does Right and well.
00:11:36.847 -->
00:11:40.729That's now the fundamental part is no longer fundamental.
00:11:40.729 -->
00:11:44.623We don't have assumptions that this is going to go on a single architecture.
00:11:44.623 -->
00:11:45.741We don't have assumptions that this is going to go on a single architecture.
00:11:45.741 -->
00:11:50.690We have multiple chip architectures GPUs, tpus, dpus.
00:11:50.690 -->
00:11:52.832That's a lot of PUs.
00:11:52.832 -->
00:11:57.655And let me tell you PU, when it comes to trying to guess which one you're going to be using.
00:11:57.736 -->
00:12:10.607If you're writing the application, that has to make assumptions that this stuff will be where it needs to be when it needs to be there, or it's going to be punishingly slow.
00:12:10.607 -->
00:12:16.123And remember the latency thresholds and the latency.
00:12:16.123 -->
00:12:23.721The cost that we're paying is so much larger Because before it'd be like ah, you've got a web transaction.
00:12:23.721 -->
00:12:25.748You're literally doing like crud operations.
00:12:25.748 -->
00:12:29.538Let's face it, 90% of applications were crud operators.
00:12:29.538 -->
00:12:31.883We're doing very simple.
00:12:31.883 -->
00:12:34.908You know reads and writes and updates to databases.
00:12:35.450 -->
00:12:41.607Yeah, but now we've got combinations of structured data, unstructured data.
00:12:41.607 -->
00:12:46.559We've got regs, so that we've got combinations of the existing model plus additional external structured and unstructured data.
00:12:46.559 -->
00:12:48.000We've got RAGs, so that we've got combinations of the existing model plus additional external structured and unstructured data.
00:12:48.000 -->
00:12:49.787It's going to live in a thousand different places.
00:12:49.787 -->
00:12:54.809It's going to be plugged in by APIs and we're going to have MCP servers all over the place.
00:12:54.809 -->
00:13:08.446Great, now we know where everything is, but how do we get to where we need it and in a way that's the most efficient and effective to perform this task at the lowest cost, at the highest efficiency?
00:13:08.446 -->
00:13:16.748And, yeah, it probably would look like an intractable problem, or at least probably a stack of intractable problems.
00:13:16.748 -->
00:13:17.910This is the intracta stack.
00:13:17.910 -->
00:13:20.504There's a lot to sort out here.
00:13:20.504 -->
00:13:21.807Sounds like a new startup.
00:13:22.206 -->
00:13:34.400Well, I mean, I think one of the things is that the traditional architectures of compute, network and storage are what we've always been working with.
00:13:34.400 -->
00:13:35.466That's what we've been playing with.
00:13:35.466 -->
00:13:37.655We've been trying out different topologies.
00:13:37.655 -->
00:13:42.909We're trying out different ways of handling the network, handling different data structures.
00:13:42.909 -->
00:13:52.591Key value is a new possibility that people are trying to approach, but the difficulty is how do you get this to work in existing traditional environments?
00:13:52.591 -->
00:13:57.280Key value and deposits they don't go well together Now.
00:13:57.280 -->
00:14:19.067So, at the same time, if you Take a step back and you think about it for a second, we have an opportunity here to really rethink the problem right, because we're talking about a completely different type of cluster, a type of networking, a different type of layout of the way that the problem has to be resolved.
00:14:19.067 -->
00:14:28.394You've got your data, you've got your compute right and you've got the transit ways of getting there.
00:14:28.394 -->
00:14:34.909Up until recently, we've not had a lot of choices in the granularity between any of these things.
00:14:34.909 -->
00:14:39.951You either had compute here, you had storage there, you had network there, and that's what you had to work with.
00:14:39.951 -->
00:14:42.634But now I've got compute in processing and I can put it anywhere.
00:14:42.634 -->
00:14:44.657But now I've got compute in processing and I can put it anywhere.
00:14:44.657 -->
00:14:48.081I can put it on the network, I can put it right next to the data.
00:14:48.081 -->
00:14:52.186I can split it out into multiple different areas.
00:14:52.186 -->
00:14:59.114I can have multiple cores or compute units solving different problems simultaneously.
00:14:59.114 -->
00:15:07.568There's a parallelism issue that is not inherent in the traditional mode of compute network and storage inherent in the traditional mode of compute network and storage, right.
00:15:07.568 -->
00:15:21.052So if I want to say I have this workload and sometimes it's better if I do the processing on the data location itself, so that I don't have any IO at all, right, well, that's not good for the entirety of an AI workload, but it is very good for some parts of it.
00:15:21.052 -->
00:15:29.933Right, I may want to do all my pre-processing and pre-training modeling using that compute near the data, right?
00:15:29.933 -->
00:15:37.418Or I might want to have additional processing on the network point, right On the network endpoint.
00:15:37.418 -->
00:15:38.260That's a possibility.
00:15:38.701 -->
00:15:49.221So if I open up my imagination for a second, I can say well, what if I put the processing where I need it, as opposed to putting the data where I need it, because now I'm just putting in all that data all the time.
00:15:49.221 -->
00:15:49.985You've got bottlenecks.
00:15:49.985 -->
00:15:54.039But what if I put processors where they're supposed to be closest to the data.
00:15:54.039 -->
00:16:01.740Well, that means that I don't have to worry about the time it takes to move data from one place to another, and that means that I don't have to worry about the idleness.
00:16:01.740 -->
00:16:03.624And that means I don't have to.
00:16:03.624 -->
00:16:08.455I can reduce my worry about the errors and how it's going to affect my workload.
00:16:09.177 -->
00:16:13.096Now I'm becoming much more efficient because I'm rethinking the nature of the problem.
00:16:13.096 -->
00:16:15.205But what do I have to do that?
00:16:15.205 -->
00:16:16.951I have to have better data movement.
00:16:16.951 -->
00:16:18.956I have to have better data locality.
00:16:18.956 -->
00:16:21.442I have to have better processing near the data.
00:16:21.830 -->
00:16:25.019Am I going to be doing it in high bandwidth memory or am I going to be doing normal memory?
00:16:25.019 -->
00:16:31.013Am I doing it with a shared pool?
00:16:31.013 -->
00:16:38.615Because now I've got clusters of GPUs acting like one big one right that have to be able to communicate across, you know, some sort of transport network, and where do I actually put the tools where I need them?
00:16:38.615 -->
00:16:48.115There's no one way to do that right now, and I'm not saying that the way that storageai is supposed to address that problem is going to be the one way to do it.
00:16:48.115 -->
00:17:00.782It's not the one ring to rule them all, but what it is is a way for people can actually get together and have a conversation about at least some way where they can line up their shots, and that's what storageai is supposed to be able to do.
00:17:01.471 -->
00:17:11.080It is a thematic approach to solving a workload problem from the data perspective, right From the lifecycle of data where does the data need to be and when?
00:17:11.080 -->
00:17:18.616And let me rephrase that when does the data need to be, not where do you want it to be?
00:17:18.616 -->
00:17:19.380Right?
00:17:19.380 -->
00:17:26.938And because, if I can have the data needs to be here, I can move a processor there now, which is before I just had the gravity was going the other way around.
00:17:26.938 -->
00:17:33.054Yeah, right, and so I think, I think, ultimately, and that's that's, that's one paradigm.
00:17:33.054 -->
00:17:35.098It's not the only paradigm, right?
00:17:35.098 -->
00:17:45.922Um, there will still be a lot of opportunity for, you know, more traditional approaches, because the workloads are built for that way and we don't want to ask the software guys to rewrite their software, right?
00:17:45.922 -->
00:17:47.623So that's a.
00:17:47.623 -->
00:17:48.369That's a big thing, right?
00:17:48.369 -->
00:17:51.676We want the workloads to continue to work as as as intended.
00:17:52.398 -->
00:17:53.582Right, right, we don't want to.
00:17:53.582 -->
00:17:54.202It's.
00:17:54.202 -->
00:17:55.496It's sort of this classic thing.
00:17:55.496 -->
00:17:56.951Like we saw this with observability.
00:17:56.951 -->
00:18:03.377People are like, oh, easy, all oh, and you had a team of developers going.
00:18:03.377 -->
00:18:08.002No, no, like we've done what we were supposed to do.
00:18:08.482 -->
00:18:11.586The sprint said to do this user story.
00:18:11.586 -->
00:18:15.751It didn't include observability data placement.
00:18:15.751 -->
00:18:19.962Like it's just like we make a set of assumptions that all of you all are sorting this problem out.
00:18:19.962 -->
00:18:24.680We've got SREs, you know, I assume that kid has the knowledge.
00:18:24.680 -->
00:18:28.901Meanwhile that kid is just like just praying that everything stays up.
00:18:28.990 -->
00:18:37.109Like we've programmatically solved a lot of these things with automation but none of them are latency really critically sensitive.
00:18:37.109 -->
00:18:41.541Like there's always this idea that we're going to send it out there.
00:18:41.541 -->
00:18:45.356We'll fire a few containers out so they may take a little while to spark up.
00:18:45.356 -->
00:18:52.412No big, we'll handle it in the queuing, we'll handle it in the caching, just so we don't drop the session.
00:18:52.412 -->
00:19:02.657We maintain state Like, okay, cool, lots of assumptions that don't care about sub millisecond latency.
00:19:02.657 -->
00:19:39.060The stuff we used to think about, like synchronous data connections, you know sub 10 milliseconds, you know metropollinary networks like this is baby problems compared to what AI introduces as the frequency of change of where data needs to be, as you said, not where we want it to be, but where it needs to be to be optimal.
00:19:39.060 -->
00:19:51.121For all this other stuff of access to CPU, gpu, like they assume, uninterrupted access to everything because interruption could mean process stopped.
00:19:52.082 -->
00:20:05.174Start over, you know, and when you're training a model that takes days to do, you can't just yeah, you can't just like oops, you know, rebooted a couple of systems on Thursday night by accident, so we got to start over.
00:20:05.174 -->
00:20:06.772You're like no, no, it's not an option.
00:20:07.294 -->
00:20:11.063Yeah, no, I mean you're, you're, you're spot on.
00:20:11.063 -->
00:20:35.086I mean the, the, the real, the real question about, about this is that when you get into what people have normally considered to be black boxes, right, the opacity of not being able to see what's going on inside your compute cluster, what's not, you know, if you're a compute person or a software person, you don't typically think about how the processor does what it does.
00:20:35.086 -->
00:20:39.698You just, most of the time, you don't care, you just sort of want it faster and better and bigger.
00:20:39.698 -->
00:20:40.954That's what you want, right?
00:20:40.954 -->
00:20:53.290However, the people who really care about this want to eke out every single possible amount of performance as they can, because, because the nature of the game is different, right?
00:20:53.391 -->
00:21:01.345So now we've got all of these different things working in parallel and the bottlenecks are in the relationship between devices.
00:21:01.345 -->
00:21:08.304Like, let me say let me give you an example I have a CPU that, let's just say generously has 200 cores.
00:21:08.304 -->
00:21:12.857That's a good beefy processor, that's a good big CPU.
00:21:12.857 -->
00:21:16.023I've got a GPU that has 15,000 cores.
00:21:16.023 -->
00:21:24.914Now, that 200-core CPU and that 15,000-core GPU are not going to have a one-to-one relationship between the communication between those cores.
00:21:24.914 -->
00:21:30.951But if I've got a GPU that needs to access that data, and I have to go through the CPU to be able to do it.
00:21:30.951 -->
00:21:40.276I have to pin at some level the relationship between what the cores are going to be asking for and what the cores can provide.
00:21:40.276 -->
00:22:05.521The transport is going to do the best it can, right, but if I need to be able to have parallel ideas of how to communicate to the storage itself, the data itself, do I want to have an ever-decreasing level of that valve that has to be open to be able to suck in the data, right, and then, of course, you have to go into the kernel and you have to come back out to suck in the data, right, and then, of course, you have to go into the kernel and you have to come back out.
00:22:05.789 -->
00:22:16.686You know we have all kinds of magic that we do inside of the operating system to be able to handle, you know, the IO part of it, and so what we're looking to do is we're trying to solve those problems.
00:22:16.686 -->
00:22:21.701Right, how do I handle a non-uniform way?
00:22:21.701 -->
00:22:30.894We talk about NUMA all the time, but what's a non-uniform way of accessing data?
00:22:30.894 -->
00:22:31.075Right?
00:22:31.075 -->
00:22:44.104That is not part of the same chip cluster, right, and that's a non-trivial problem, and you need to have the cooperation of processors and data and all the vendors of the above listed ones.
00:22:44.104 -->
00:22:47.298Right, and what happens if you don't have this locally?
00:22:47.298 -->
00:22:49.193You got to go over a network to do it.
00:22:49.193 -->
00:22:51.221Right, how do you do that?
00:22:51.221 -->
00:22:57.083Well, that's why you know we're going to be working with you know, the partners for SNEA, right?
00:22:57.849 -->
00:22:59.737Ultra Ethernet is a really good example of this.
00:22:59.737 -->
00:23:00.559Right?
00:23:00.559 -->
00:23:01.731How do you do you know?
00:23:01.731 -->
00:23:08.923If you're going to do file-based storage or object-based storage over RDMA, that implies you're going to be able to do it over AlterEthernet too.
00:23:08.923 -->
00:23:12.659Yeah, right, so that's not SNEA's job.
00:23:12.659 -->
00:23:19.584Snea does the file and object part, but the RDMA part, the UE part, that's a networking group, right?
00:23:19.910 -->
00:23:34.111So it's very important that SNEA work with these other organizations to be able to control you know a end-to-end way of solving these problems and fortunately, snea and UltraEthernet have a very good working relationship.
00:23:34.111 -->
00:24:03.924So it's not just where do you, where does the data need to be, but where does the work need to be, and so that's why having an organization like SNEA, with its long tail of you know, its reputation and its you know established workloads, work streams, is a really good place to handle the storage and the data services, and then work with groups like UEC and OCP and DMTF for management and NVM Express for the protocols and so on and so forth.
00:24:03.924 -->
00:24:08.079Right, right tool for the job, right organization for the job.
00:24:08.079 -->
00:24:17.443And so that's why we're doing what we're doing, because if we succeed at what we're seeking out to accomplish, everybody wins.
00:24:17.443 -->
00:24:20.351It's the rising tide rins all boats right Now.
00:24:21.093 -->
00:24:23.500Obviously, some of the stuff is going to take a long time.
00:24:23.500 -->
00:24:24.714Some of the stuff is already there.
00:24:24.714 -->
00:24:34.528Right, many of the projects we're already working on have been established inside of SNEA for a long time, but we haven't looked at it from the perspective of being a part of a bigger workload.
00:24:34.528 -->
00:24:36.615Right, that's the new part.
00:24:36.615 -->
00:24:47.873Right, creating an entire community of vendors and people and partners and academics and organizations to solve a workload-specific problem.
00:24:47.873 -->
00:24:48.896That's new.
00:24:48.896 -->
00:24:52.738That's a new thing for us, and so we're very excited about that in particular.
00:24:53.830 -->
00:25:01.240Well, and this is really funny that as we started off, we thought of this idea that this is brand new, it's an announcement, it's a big thing.
00:25:01.240 -->
00:25:31.483What it really is is the culmination of decades of collaboration, effort and building standards-driven innovation, and the reason why this is so important that it lives in this Snea world and in between UltraEthnet, we've got CXL, we've got all these different folks that are going to be involved is just because we've got SDXI, we've got CXL, we've got all these different folks that are going to be involved is just because you know we've got SDXI, we've got CXL, we've got you know what's around data storage.
00:25:31.483 -->
00:25:32.345We've got data security.
00:25:32.345 -->
00:25:32.609You know.
00:25:32.609 -->
00:25:34.394You talked about the idea like when do we?
00:25:34.394 -->
00:25:36.077You know where do we put the data?
00:25:36.077 -->
00:25:36.819Okay, cool.
00:25:36.819 -->
00:25:37.801When do we move it?
00:25:37.801 -->
00:25:38.262Okay.
00:25:38.262 -->
00:25:40.477Second problem you know where do we move it to?
00:25:40.477 -->
00:25:55.386Okay, another the data, or protect the data, or provide resiliency and multi-path, like you know.
00:25:55.406 -->
00:26:11.221Like you said, we've we've had multi-cpu for, you know, decades at this point, yet it took us till not too long ago really to really use all those cpus and cores, right, how many applications have you seen written in enterprises where it's like cpu one, 98.
00:26:11.221 -->
00:26:17.545You know, core two, three, four, five, six, seven, eight, all the way up to 16, 0%.
00:26:17.545 -->
00:26:23.065Congratulations, you've just underused the hardware in the worst way possible.
00:26:23.065 -->
00:26:35.039And now, when we think of what we saw with stuff like TPM, when stuff was moving what we believe to be securely between memory cache and CPU, it was like, oh wait, a memory cache and CPU.
00:26:35.039 -->
00:26:40.009It was like, oh wait, a second somewhere in the middle that could get hijacked.
00:26:40.009 -->
00:26:52.681And so how do we make sure that we can actually protect it and understand the path of, you know, the path of transit, securing the path, securing at rest, securing like it's many, many things.
00:26:53.095 -->
00:26:59.175And security, why we always said why do you have to call it DevSecOps, not just DevOps, like?
00:26:59.175 -->
00:27:03.442Because when we called it DevOps, no one invited the security team.
00:27:03.442 -->
00:27:05.461We had to be overt.
00:27:05.461 -->
00:27:09.526And again, one of those things that just we assume.
00:27:09.526 -->
00:27:13.135We've made this assumption that someone's taking care of security, like.
00:27:14.156 -->
00:27:24.891Well, now we've got all of these multi-purpose groups in a single working community who then also can go hey, you know, we're also working on this.
00:27:24.891 -->
00:27:29.694Right, it's no longer your storage, your CPU, your GPU and your security.
00:27:29.694 -->
00:27:34.467Now it's like your storage and we're working with security and network.
00:27:34.467 -->
00:27:39.724Everybody's got to collaborate together, and the only way you can do that is to have, like I said, a lingua franca.
00:27:39.724 -->
00:27:43.059You have to have some kind of a little orphan Annie decoder ring.
00:27:43.059 -->
00:27:48.730For those older folks like myself, drink your whole tea, yeah.
00:27:48.730 -->
00:28:10.852So it's a great time to see this, and while it may seem like out of the blue to many, this actually has just been lying in wait and now it's just becoming visible the work that's happening, the collaboration that has been occurring, and now that can occur at a much faster rate in public.
00:28:11.736 -->
00:28:15.465Yeah, it's like the actor who's's taken 15 years to be an overnight success.
00:28:15.974 -->
00:28:18.278Right, exactly, and then you see them with.
00:28:18.278 -->
00:28:20.377That's such a perfect example.
00:28:20.377 -->
00:28:21.502Because then you see that person.
00:28:21.502 -->
00:28:26.961You're like, remember when Mr Robot came around, and then the guy from Mr Robot also, and they're like, man, he's in like 10 different movies.
00:28:26.961 -->
00:28:33.082So like, yeah, because you know, when Mr Robot was written and produced, it was four years ago, so then they knew it was going to be good.
00:28:33.082 -->
00:28:40.576So then he's got an agent who's been like, ah yeah, so this is what's been going on while AI is this brand new thing.
00:28:40.576 -->
00:28:46.675You're like, well, ai has an agent, not that kind of agent and it's been out there shopping around.
00:28:46.776 -->
00:28:51.968So AI now has a little bit of everything, just like the guy that sells cranberries.
00:28:51.968 -->
00:28:57.767Whoever's the cranberry salesman, that person has been getting cranberries in every drink known to person.
00:28:57.767 -->
00:29:18.511Kind, hope, somebody's on commission for that efficient, secure and it's not negatively affecting the users and the overall ecosystem.
00:29:18.511 -->
00:29:31.916We're really creating a protection scenario as well, because we've got power, we've got data protection, we've got security, storage, retention, all this stuff like what data stays, what state it can go.
00:29:31.916 -->
00:29:39.390There's so many questions that are being re-asked that we think we just solved in enterprise computing, but everything changed.
00:29:40.234 -->
00:29:47.148Well, you also put your finger on, maybe inadvertently, but I think it's very important to kind of zero back in on.
00:29:47.148 -->
00:29:54.617You said you know people think well, somebody should do this right, Somebody should solve this particular problem.
00:29:54.617 -->
00:29:57.544And why isn't somebody doing that?
00:29:57.544 -->
00:30:00.429Why isn't, you know, anyone thinking about this?
00:30:00.429 -->
00:30:07.097Why isn't anybody working on these problems?
00:30:07.097 -->
00:30:10.606And the short answer is because sometimes the problems are very big and very complex and no one somebody can do it.
00:30:10.606 -->
00:30:13.856We are the somebody for this right.
00:30:13.856 -->
00:30:15.222The data problem is a very real problem and somebody should do it.
00:30:15.222 -->
00:30:16.027We are the somebody for this right.
00:30:16.027 -->
00:30:18.878The data problem is a very real problem and somebody should do it.
00:30:18.878 -->
00:30:20.704And it's true, and we are that somebody.
00:30:20.704 -->
00:30:36.167We are the ones who are going to be working on a very complex and very ambitious project to make sure that the data does not get overlooked or is an afterthought, or you know something along those lines.
00:30:36.167 -->
00:30:43.477And so SNEA is the somebody who's looking at that problem, and so that's why we're looking to make sure that.
00:30:43.758 -->
00:30:47.326You know, I've been personally reaching out to as many companies as possible.
00:30:47.326 -->
00:30:51.286I've been, you know, the hyperscalers, the storage vendors, the processor vendors.
00:30:51.286 -->
00:31:02.440I've been on all kinds of calls with people and I hope if they do see this and you listen to this, they realize I've been consistent in my message here.
00:31:02.440 -->
00:31:16.519But I honestly do think that we have a moral and ethical responsibility to doing things correctly, not just from the content perspective, but also from the end user's perspective.
00:31:16.519 -->
00:31:40.784Right, yeah, and I think that when we start to try to do the shortcuts in getting these things out the door so that various companies can make the money that allow them to operate nothing wrong with that, I'm a big capitalist Sometimes we forget that we build in problems, we build in cul-de-sacs of technologies in the future.
00:31:42.287 -->
00:31:46.867Now, I don't think that when you get to a certain stage, that's a good thing.
00:31:46.867 -->
00:32:08.042I don't think that when you're talking about a million inputs, when you're talking about building nuclear power plants, to solve one AI workload problem, that it is sufficient to say, well, oops, well, we just we kind of backed ourselves into a corner Right and so the waste and the inefficiency becomes very, very real.
00:32:08.042 -->
00:32:26.374Architects, as technologists, to at least attempt to address that problem so that in the future we don't have to completely undo all of this work and all of the money that's spent and all the effort that's put into time and all the man hours that have been put into this are wasted.
00:32:26.374 -->
00:32:30.163Right, I certainly want all the work that I do to actually mean something in the future.
00:32:30.163 -->
00:32:31.897I think a lot of people do as well.
00:32:32.378 -->
00:32:38.913But even more importantly than that, you know, I do think that when we come up with a solution, it's not just about the hype cycle.
00:32:38.913 -->
00:32:42.804It's really about, you know, solving the problem.
00:32:42.804 -->
00:32:47.416And so, you know, from a you know, from a personal perspective, it's very important.
00:32:47.416 -->
00:32:53.798It's very important to me that we actually do something that has an import has an import?
00:32:53.818 -->
00:33:12.181Yeah, because long after the memes, the standards will remain and you know, while we, culturally, are latching onto whatever's current, active and most front of mind and the local problem that we have to solve I think Jim Keller said a great.
00:33:12.181 -->
00:33:22.948He says we, as developers, we, you know, we solve extremely hard problems so that we can then introduce the next really hard problem.
00:33:22.948 -->
00:33:25.419Like that's the goal.
00:33:25.419 -->
00:33:34.041The goal is to solve something so well that it feels solved, but then you find a new problem and this is it we have.
00:33:34.041 -->
00:33:34.461Now.
00:33:34.461 -->
00:33:38.127We understand how these systems work.
00:33:38.127 -->
00:33:50.143Llms are everywhere, we've got all this innovation going on, but now this is the next hard set of problems to solve and the fact that we're solving them as a community.
00:33:50.143 -->
00:34:04.969It's just a chance that when you're in a room of people that are like-minded, with like goals as parent, supporting companies, all these member organizations all win when we're in the room going hey, so I just figured something out.
00:34:04.969 -->
00:34:07.717They solved a problem that we've been looking at for a long time.
00:34:07.717 -->
00:34:25.418Like that is the value of innovation as a group and standards driven innovation, because sometimes standards come, because we find them, and sometimes we create the standard and then we develop into it.
00:34:25.418 -->
00:34:29.405I'd say that AI has effectively started.
00:34:29.445 -->
00:34:31.556You know, we saw MCP just showed up out of nowhere.
00:34:31.556 -->
00:34:33.360You know, on Thursday.
00:34:33.360 -->
00:34:35.686Mcp was defined by Monday.
00:34:35.686 -->
00:34:37.289It was just like dude, are you even running?
00:34:37.289 -->
00:34:39.884Like, if you're not running MCP server, what are you even doing?
00:34:39.884 -->
00:34:43.998You're like that didn't take long before we realized what's wrong with you.
00:34:43.998 -->
00:34:45.684Man, like geez really.
00:34:45.684 -->
00:34:49.375And then you think like, do I really throw myself at this Cause?
00:34:49.375 -->
00:34:52.425In two weeks are people going to be like oh, mcp was so last month.
00:34:52.425 -->
00:34:57.539Weeks are people gonna be like oh, mcp is so last month.
00:34:57.539 -->
00:34:58.420You're like we saw, we've got mcpi now.
00:34:58.420 -->
00:35:10.989You're like but so some things get discovered and we're, we're building in public, which is kind of cool, but then people are losing sight of what's actually being built on did you ever see, oh?
00:35:11.028 -->
00:35:12.436I'm sorry I interrupted, please continue.
00:35:12.436 -->
00:35:14.559Oh no, no, it's like, but like you, you really said it.
00:35:14.559 -->
00:35:20.184For like, all the outcomes are are already being solved, like we're.
00:35:20.184 -->
00:35:27.251We know we're solving and we're solving the problems that make those outcomes faster, secure, reachable, extensible.
00:35:27.856 -->
00:35:29.059Yeah, yeah.
00:35:29.059 -->
00:35:37.481And when we were talking about you reminded me of an old, uh, an old, an old clip of uh, steve Jobs talking about the laser printer.
00:35:37.481 -->
00:35:38.679Did you ever see that clip?
00:35:39.695 -->
00:35:42.360This one sounds familiar now, so but run it through me.
00:35:43.755 -->
00:35:49.878So he was doing a town hall, as he often does, or did Um and uh he was.
00:35:49.878 -->
00:35:59.230This was back in the mid nineties, back when open doc was a big thing, and so one of his engineers got up and braced.
00:36:00.717 -->
00:36:01.481I think I know this one.
00:36:01.481 -->
00:36:03.501He goes oh, here it comes.
00:36:03.501 -->
00:36:06.664It's like one of the famous ones, yes, yes.
00:36:11.563 -->
00:36:14.588And he said okay, look, why are we not following the industry standard on OpenDoc?
00:36:14.588 -->
00:36:21.126I did not expect the answer that Steve gave.
00:36:21.126 -->
00:36:34.875Steve was like one of the things about being in charge is that you're going to get really good, difficult questions like this and when we start to make the decisions, you have to make very difficult decisions.
00:36:34.875 -->
00:36:41.583You know there are, there are going to be really good technologies and they're going to solve a lot of different problems.
00:36:41.583 -->
00:36:49.860The problem and he's he was talking specifically from Apple's perspective of selling a product, and I'm thinking more in terms of selling an idea, but the principle is the same.
00:36:49.860 -->
00:37:11.940So he said look, you know when, when we started working on the laser printer, the Apple laser printer which, for those people who may not be aware, the the, the Apple laser printer, was the first affordable printer for businesses that didn't cost hundreds of thousands of dollars, that that was laser oriented.
00:37:11.940 -->
00:37:21.679And he said we've got really good technology in there, we've got PostScript in there, we've got a lot of hardware stuff and they got chips in there All really good technology.
00:37:21.679 -->
00:37:22.442Was there better ones?
00:37:22.442 -->
00:37:28.867Possibly right, but when you saw the output of the laser printer, he said this I can sell.
00:37:29.617 -->
00:37:30.460I can sell this.
00:37:30.460 -->
00:37:32.081I can't sell OpenDock.
00:37:32.081 -->
00:37:33.297I can't sell PostScript.
00:37:33.297 -->
00:37:34.958What I can sell this I can't sell OpenDoc, I can't sell PostScript.
00:37:34.958 -->
00:37:36.782What I can sell is this this is what's important.
00:37:36.782 -->
00:37:41.409I believe storageai is something similar.
00:37:41.409 -->
00:37:56.195Right, I can go through each and every one of the technical working groups that we've got and I can say to the cow from home that this particular solution is great, is going to make you do everything you want it to do, plus make you lunch right.
00:37:56.996 -->
00:38:04.342The reality of it is that if it's divorced from the workload or if it's divorced from solving a problem, I can't sell the PostScript.
00:38:04.342 -->
00:38:05.925I can sell the laser printer.
00:38:05.925 -->
00:38:10.264I can sell conceptually the idea of storageai.
00:38:10.264 -->
00:38:16.722I can sell the fact that these things are working together to bring a result to people who have a problem.
00:38:16.722 -->
00:38:33.255That goes beyond whether or not this bit moves to that register Right, and I can say consistently, repeatedly over time, reliably, that if you do this, you will get the result that you want, and I think that's the thing that people want more than anything else.
00:38:33.355 -->
00:38:44.927They don't want to have to reinvent the wheel every single time I come up with a processor, every single time I come up with a new memory format, every single time I come up with a new nan format or new networking protocol.
00:38:44.927 -->
00:38:55.184Right, I want to make sure that the the thematic approach, just like that laser printer, is going to solve the problem again and again, and again.
00:38:55.184 -->
00:38:57.802And that is what we're bringing to the table here.
00:38:57.802 -->
00:39:08.264I'm not just bringing SDXI, I'm not just bringing computational storage, I'm bringing in the conceptual analogy to the laser printer in storageai.
00:39:08.264 -->
00:39:12.273To me, it's I'm okay with that.
00:39:12.273 -->
00:39:16.650To me, that's a win 100%.
00:39:16.931 -->
00:39:18.693Yeah, and this really is.
00:39:18.693 -->
00:39:25.784You know, you couldn't do it without being able to tap the existing active working groups.
00:39:25.784 -->
00:39:30.141It is such a natural extension to what already existed.
00:39:30.141 -->
00:39:31.572So this is.
00:39:31.572 -->
00:39:42.302It couldn't have landed in a better community as far as I'm concerned, and it also couldn't have come at a more, you know, important time.
00:39:42.302 -->
00:39:49.143Every day is a great day to be in technology and an incredibly challenging day to be in it as well.
00:39:51.476 -->
00:39:58.833So, yeah, and you know, all of this stuff that we were trying to solve with software defined storage.
00:39:58.833 -->
00:40:16.643Then it became, you know, we griped over the terms and all these things, and then we've got network storage and network transports and all of a sudden we've got, you know, containers that are running on disk controllers that are actively doing computing your data, running on disk controllers that are actively doing computer near data.
00:40:16.663 -->
00:40:18.684And that's been around for decades.
00:40:18.684 -->
00:40:26.608It's just that it's never been done consistently at scale, knowing that we have the potential to reach the outcome.
00:40:26.608 -->
00:40:33.081Like you said, if you went to the drawing board and said, if we design a laser jet, it's going to be able to do this amazing thing.
00:40:33.081 -->
00:40:34.757Here's a mock-up of what it is.
00:40:34.757 -->
00:40:40.641Just go to all these different tools and you can go there today.
00:40:40.641 -->
00:40:41.702Just do a Google search.
00:40:41.702 -->
00:40:51.717Didn't mean to mention a brand name, but just do a generic search and say AI, generation X, whatever tool it's going to be, and it's there.
00:40:51.717 -->
00:40:57.012It's working today because they've tried to individually solve a really strong problem.
00:40:57.012 -->
00:40:58.032But how are they solving it?
00:40:58.032 -->
00:41:01.574Cash flow we got to solve.
00:41:01.574 -->
00:41:04.257What's the best place for folks to get more information about what just came out?
00:41:04.257 -->
00:41:33.304How to get involved with Storageai as an initiative and how to dig in and get their happy little AI-loving feet wet on this fantastic working group?
00:41:34.351 -->
00:41:36.358What a visual did you just put in my head?
00:41:36.358 -->
00:41:45.061I'm going to let the AI filmmakers get away with that one.
00:41:45.061 -->
00:41:54.224So obviously, sniaorg is the best way to go for all things SNIA.
00:41:54.224 -->
00:42:06.817We are going to have a lot more information over the next coming weeks, next coming months, especially as we go through and out of conference season in the fall of 2025.
00:42:06.817 -->
00:42:15.378We also have Thiniaai as a new landing point for where the Storageai work is going to be.
00:42:15.378 -->
00:42:19.681Over time, you'll see that fill out with more and more information.
00:42:19.681 -->
00:42:30.682Obviously, the SNEA Developer Conference is going to be a really good resource and if you can't make it live, then over time the videos will be available on YouTube.
00:42:30.682 -->
00:42:41.742So there's a lot of material that you can find out from the SNIA and the SNIAorg family of sites and, of course, there'll be more posting on LinkedIn and ex-formerly Twitter.
00:42:41.742 -->
00:42:45.179I still call it Twitter as well, without question.
00:42:46.652 -->
00:43:01.012And I think the fact that people that are in the organizations are obviously aware of the collaboration capability in the organizations are obviously aware of the collaboration capability, but I love that more and more smaller companies and startups have a chance to participate.
00:43:01.012 -->
00:43:04.402It's not onerous or incredibly costly to be involved.
00:43:04.402 -->
00:43:11.152Like it just everybody wins at least to go in and tap the community for questions, to understand what's being done.
00:43:11.152 -->
00:43:33.342Cause they're they are really just an amazing group of fantastic humans like yourself who are spending their hard time and hard yards to do that early innovation and discovery and research so that we know when we go live that we're trying to do it towards that optimized goal and security.
00:43:33.342 -->
00:43:38.041Folks get in because this is one of the best times to be in there.
00:43:39.210 -->
00:43:45.900The security folks, the energy efficiency folks, the power folks all have a very strong play in this.
00:43:46.829 -->
00:43:54.882Yeah, and this is not a Bill Hicks style like, oh, let's throw some cost savings on top of it, let's put some sustainability on there.
00:43:54.882 -->
00:43:56.097We don't want the marketing people to savings on top of it, let's put some sustainability on there.
00:43:56.097 -->
00:43:58.637You're like, no, like we don't want the marketing people to get ahold of this.
00:43:58.637 -->
00:44:02.077This is like we're building sustainability in reality.
00:44:02.077 -->
00:44:08.476I mean, as a marketer, I can safely say that, but no marketers were hurt in the context of this conversation.
00:44:08.476 -->
00:44:11.097But like that, that's it.
00:44:11.097 -->
00:44:12.490You know, people need to get in.
00:44:12.851 -->
00:44:17.735Every aspect is being discussed and these are the people doing the work.
00:44:17.735 -->
00:44:21.097This is not, god bless, my fine friends who are pundits.
00:44:21.097 -->
00:44:33.487These are not the pundits who are having fireside chats on every AI conference stage about the ethics of AI for the 438,000th time and saying nothing.
00:44:33.487 -->
00:44:37.978Right, yeah, coming to the same conclusion, which is we should really talk about this more.
00:44:37.978 -->
00:44:42.960Wow, good luck with that.
00:44:42.960 -->
00:44:50.467So you know, while everybody's talking, stuff's getting done, and you got to be at SDC to make sure that you're there doing it with them.
00:44:50.467 -->
00:44:53.079So we'll have links, of course, in the show notes.
00:44:53.079 -->
00:45:04.204And of course, don't forget, there's other amazing conversations like this one with Jay and other amazing humans who are part of the SNEA organization and other contributing and partner orgs.
00:45:04.204 -->
00:45:07.849We've met with folks from all sorts of organizations in the past.
00:45:07.849 -->
00:45:15.072So SNEA experts on data, jay Metz, thank you so much for taking the time and if people do want to find you, what's the best way to do that?
00:45:15.092 -->
00:45:19.559you so much for taking the time and if people do want to find you, what's the best way to do that?
00:45:19.559 -->
00:45:20.260Probably through LinkedIn.
00:45:20.260 -->
00:45:30.954My name J Metz, my Twitter handle is Dr J Metz and at Dr J Metz, and those are probably the two or.
00:45:30.954 -->
00:45:34.733I haven't been posting recently, but my website, jmetzcom, also does talk about some of these things, although, like I said, I haven't done much recently.
00:45:34.733 -->
00:45:40.755But those are the best ways to reach me, the LinkedIn is a definite must follow.
00:45:40.976 -->
00:45:43.652I love your newsletters and your takes on.
00:45:43.652 -->
00:45:46.260Stuff is really good to see, you know.
00:45:46.260 -->
00:45:56.637Sometimes you know appropriately biting but honest discussions about some really interesting challenges that we're seeing in the industry.
00:45:56.637 -->
00:45:59.820So with that, dr Jamez, thank you so much.
00:45:59.820 -->
00:46:07.556And for folks, of course, check it out, make sure you get to sneaorg and now sneaai Now with 100% more AI.
00:46:07.556 -->
00:46:08.954Sorry, that is the marketer me.
00:46:08.954 -->
00:46:15.512All right, folks, have a good one and we'll see you all on the next podcast.