O TYM ODCINKU
AWS and Azure just did the thing everyone argued would never happen: a managed, first party multi-cloud interconnect between the two biggest cloud platforms. We break down what’s actually new here, what’s simply being productized, and why this matters for enterprise cloud networking, identity driven architectures, and outage aware design. We also talk honestly about the current limitations and where high throughput connectivity still depends on ExpressRoute, Direct Connect, and established data centre cross connect ecosystems.
Then we pivot to the AI platform earthquake: NVIDIA’s planned $12.9B acquisition of Hugging Face. We explore incentives and power dynamics behind buying the “AI model repository” that hosts millions of open models and datasets. Does this make open model development easier and faster, since NVIDIA sells the GPUs that run everything, or does it create a new choke point the industry should monitor?
From there, we connect the dots to AI infrastructure economics and security. We discuss the growing debt and risk in data centre financing, including reports of scaled back guarantees on a major build, and why that matters beyond tech circles. We also unpack the OpenAI agent breach story with the nuance mainstream coverage often skips: a hacking test, an internet path through a proxy, weak monitoring, and why those details change the lesson. We wrap on a lighter note with GPT-6 Astra early impressions and what rapid prototyping can look like when the model is genuinely better. If you found this useful, subscribe, share it with a colleague, and leave a review with your take on multi-cloud and open models.
Check out the Monthly Cloud Networking News
https://docs.google.com/document/d/1fkBWCGwXDUX9OfZ9_MvSVup8tJJzJeqrauaE6VPT2b0/
Visit our website and subscribe: https://www.cables2clouds.com/
Follow us on BlueSky: https://bsky.app/profile/cables2clouds.com
Follow us on YouTube: https://www.youtube.com/@cables2clouds/
Follow us on TikTok: https://www.tiktok.com/@cables2clouds
Merch Store: https://store.cables2clouds.com/
Join the Discord Study group: https://artofneteng.com/iaatj
POKAŻ NOTATKI 🔗
TRANSKRYPCJA 🔗
00:00:06.719 --> 00:00:14.080
Hey everybody, and welcome to another news episode, Fortnite the News episode of the Cables to Clouds podcast.
00:00:14.080 --> 00:00:21.359
This week it's me, Tim, your co-host, uh with Catherine, your other our other co-host.
00:00:21.359 --> 00:00:25.199
So let's just uh roll right into the news here.
00:00:25.440 --> 00:00:26.800
Uh there it is.
00:00:27.120 --> 00:00:27.600
All right.
00:00:27.600 --> 00:00:36.320
So first first order of business is something we honestly two or three years ago when we started this thing, we didn't think we'd ever actually be reading.
00:00:36.320 --> 00:00:37.520
Uh, but it keeps happening.
00:00:37.520 --> 00:00:38.719
So this is a big one.
00:00:38.719 --> 00:00:44.079
Uh so AWS and Azure have now launched a managed multi-cloud interconnect.
00:00:44.079 --> 00:00:52.399
So that's as the two kind of cloud, you know, de facto market leaders, this this is the one that has been kind of hanging in the air for a long time.
00:00:52.399 --> 00:01:06.400
We've, you know, we've had AWS partner with other providers and Azure partner with other providers, but now we're finally seeing uh multi-cloud connectivity between those two, which again, three years ago we would have never thought would happen.
00:01:06.400 --> 00:01:13.760
So Microsoft and AWS have merged the AWS Interconnect and the Azure Multi-Cloud Interconnect into a single resource.
00:01:13.760 --> 00:01:28.319
Uh they've, you know, there's a standardized open API spec so that customers will be able to build essentially both sides of the connection via API or console infrastructure code, you know, the normal ways.
00:01:28.319 --> 00:01:34.480
And then they can basically just use it as a bespoke internet, uh, intercloud connection between them.
00:01:34.480 --> 00:01:37.040
This is this technology is not new, right?
00:01:37.040 --> 00:01:45.680
It's just really this is the you know, the two cloud market leaders are finally doing it together, you know, going into business together with it.
00:01:45.680 --> 00:02:02.959
And I'm I have to assume that the reason for this is either they're just closing the loop, meaning like they already have so many other uh partnerships out there that it's time to do it, or they're doing it because of customer demand and they just can't kind of ignore the fact that most customers are in multiple clouds at this point.
00:02:02.959 --> 00:02:11.360
So yeah, the question is what what fed it, and we're probably not gonna get an answer from the providers themselves.
00:02:11.360 --> 00:02:23.759
Now, yeah, Catherine, I know you probably haven't play haven't messed with this too much because this is a little bit outside your wheelhouse, but uh two market leaders going into business together, uh it's interesting.
00:02:24.080 --> 00:02:30.879
Um yeah, it is, but I also think it's uh I I think it's part of like what we're seeing these days.
00:02:30.879 --> 00:02:37.759
Like I have a lot of customers in my day job that have like investments or servers in multiple clouds.
00:02:37.759 --> 00:02:47.439
And I I think when cloud first became hot, it was always like it was like, you know, it it was more acceptable, or at least it started out with people putting their eggs in one basket.
00:02:47.439 --> 00:03:00.240
These days, I think uh it's more common to see people with like using a little bit of uh AWS, but uh of course now you have Azure and and uh you know part of Azure is like getting a Jure uh entre ID and other things.
00:03:00.240 --> 00:03:12.080
So if you're using Microsoft for like identity and stuff like that, or directory services um and MDM, you you typically will have a little investment in Azure and and other places.
00:03:12.080 --> 00:03:19.039
So it it from a business perspective, it it makes sense as as a lot of these things like uh you know have matured over time.
00:03:19.039 --> 00:03:30.240
Um it'll be interesting to see like, you know, how how it ends up working out, like if it are locks other vendors out of the market like OCI or Google Cloud, or they'll start to form their own partnerships.
00:03:30.800 --> 00:03:32.240
Yeah, that's yeah.
00:03:32.240 --> 00:03:43.599
I think I think by the time this thing whole thing is done, I mean the technology, which is the cross connects in in different uh data centers where they all have presence, uh we'll we'll see that.
00:03:43.599 --> 00:03:52.639
I think I think that there's probably more of a of an administrative blocker than any kind of technical blocker now to having all of these cloud providers connect together.
00:03:53.120 --> 00:03:53.280
Yeah.
00:03:53.280 --> 00:04:07.439
When I was so many years ago when I first started at Cisco, one of like the products that we developed uh and we brought to market was like a basically a pro a product that uh that uh that kind of orchestrated between different cloud environments.
00:04:07.439 --> 00:04:18.000
So you could basically pay to have an unofficial connect interconnect where you could like migrate one VM to another cloud's uh another cloud's provider and not lose your data.
00:04:18.000 --> 00:04:23.839
And that like at the time was like inver considered novel and great, so you wouldn't have that like uh that lock-in.
00:04:23.839 --> 00:04:35.279
But now and now, like now more and more we're seeing people are just like, yeah, AWS East went down, Cloudflare went down, this went down, so we can't have stuff in in the same in all in the same basket.
00:04:35.279 --> 00:04:46.560
And plus, you know, there we need uh, you know, we have you know, we have certain, you know, like OCI, for example, is considered a lot cheaper, not necessarily user-friendly, but like a lot cheaper than other uh cloud providers.
00:04:46.560 --> 00:04:54.319
So you'll have some customers load up a lot of the more expensive VMs there and keep other things in AWS or different teams using different clouds.
00:04:54.959 --> 00:04:55.920
Yeah, for sure.
00:04:55.920 --> 00:05:02.160
So uh now I did see that there's a current a current bandwidth limitation of only one gig.
00:05:02.160 --> 00:05:05.600
So for some engine for some enterprises, that's gonna be fine.
00:05:05.600 --> 00:05:09.439
For other enterprises, that's you know, not really fixing a problem.
00:05:09.439 --> 00:05:19.519
Um they'll they'll probably stick with uh Megaport or Equinix or whoever with their you know uh currently provisioned uh express routes um or direct connects.
00:05:19.519 --> 00:05:22.480
But anyway, so moving on.
00:05:22.480 --> 00:05:28.720
Uh NVIDIA acquires Hugging Face for 12.9 billion with a B dollars.
00:05:28.720 --> 00:05:30.959
Uh I did not see this one coming.
00:05:30.959 --> 00:05:35.360
This is like stupid money, of course, being tossed around for stupid reasons.
00:05:35.360 --> 00:06:02.319
But yeah, so I mean Hugging Face has been around since well for a very long time in this, in this, I hesitate to call it an arms race or or an AI race or whatever, but Hugging Face basically, for those who don't know, it's like uh like a GitHub or like a repository for AI models, for open models and and whatnot to be um uh hosted so that others can download them.
00:06:02.319 --> 00:06:16.879
So NVIDIA basically just agreed to buy this company Hugging Face uh for $12.9 billion, which is a crazy amount of money, with a closing expected in the first half of 2027, assuming they get regulatory approval to happen.
00:06:16.879 --> 00:06:20.480
Now NVIDIA has already said that they're gonna keep it as an open platform.
00:06:20.480 --> 00:06:29.759
Um but let's not forget that NVIDIA is also kind of you know, it's like the the baker owning their own kitchen tools or something.
00:06:29.759 --> 00:06:36.480
You know, like it's it's they certainly have a have a uh vested interest in in doing so, right?
00:06:36.480 --> 00:06:41.120
So, you know, the the the monopoly owns the registry.
00:06:41.120 --> 00:06:45.199
So what's that gonna actually mean moving forward for open models?
00:06:45.199 --> 00:06:49.120
I think we'll still see open models, but I I wonder if there'll be any kind of strong arming.
00:06:49.120 --> 00:06:52.319
I I guess it's too early to really figure out what this is gonna look like.
00:06:53.040 --> 00:07:10.639
If I had a guess, yeah, if I had to guess, uh Nvidia, who sells you know GPUs like crazy and one of the most profitable companies in the world right now, has a vested interest to continue having people create their own models, share, download, because they have to run it on something.
00:07:10.639 --> 00:07:13.680
And who's the number one GPU provider right now?
00:07:13.680 --> 00:07:15.360
Oh, um, NVIDIA.
00:07:15.360 --> 00:07:23.040
Um, for those who don't know, Hugging Face hosts over, I think it's over two million uh open models that you can download.
00:07:23.040 --> 00:07:31.759
It's ridiculous plus a crap ton of um of data sets that you can download and and and load up into your own models.
00:07:31.839 --> 00:07:33.360
So for training, yeah.
00:07:33.759 --> 00:07:41.279
Yeah, like it is like the GitHub of of uh of uh um AI tools, like data sets and models.
00:07:41.279 --> 00:07:48.319
Like if you if you want to go and just download and like a test a local model on your own, or if you had the compute for a big beefy one, boom, right?
00:07:48.319 --> 00:07:49.360
Go to Hugging Face.
00:07:49.360 --> 00:08:02.319
Um just like when I mean I I I I think that there's been some disappointments with you know with uh GitHub since uh Microsoft bought it, but for the most part it's stayed pretty open.
00:08:02.319 --> 00:08:10.959
Um it's maybe some downtime issues and always a crashing, but for the most part, for the most part you can still use it for what you used to use it for.
00:08:10.959 --> 00:08:16.319
Um I I don't see it being profitable for Nvidia um to shut this down.
00:08:16.319 --> 00:08:20.879
If anything, they're gonna try to make it grow faster.
00:08:20.879 --> 00:08:28.720
And uh because again, these models are have to be run on something and they sell what it's run on.
00:08:29.519 --> 00:08:30.240
Yeah, 100%.
00:08:30.240 --> 00:08:39.679
I mean, it's like the uh the weapons dealer, you know, like the weapons dealer selling to all the uh the people that need to, you know, to go to war, if you will.
00:08:39.679 --> 00:09:02.639
So it definitely makes sense for them to keep it available, uh keep it I mean, open open with uh air quotes, I guess it's gonna it they're gonna want people running uh contributing models, contributing trading data set, like just basically keeping the the registry moving, keeping keeping it uh current, you know, if nothing else.
00:09:02.639 --> 00:09:13.519
So yeah, I I see no reason to think that NVIDIA is gonna do anything but just continue to do what they're doing with Hugging Face, or let Hugging Face keep doing what it's doing.
00:09:13.519 --> 00:09:18.000
Rather, I think the yeah, I I think the question is what does it mean?
00:09:18.000 --> 00:09:19.519
What does that what does it mean?
00:09:19.519 --> 00:09:33.519
You know, if they is there is there a situation that I can I can't think of one off the top of my head where, you know, NVIDIA's uh what is it, they're what they're looking to have happen might be different than something that might go on to Hugging Face.
00:09:33.519 --> 00:09:34.639
I I can't see it though.
00:09:34.639 --> 00:09:36.720
I mean they really like you said, they own the road.
00:09:36.720 --> 00:09:41.519
You know, they're selling axes and shovels to people who need axes and shovels.
00:09:42.000 --> 00:10:01.039
Yeah, if it was like anthropic or uh open AI that purchased it, I would have some serious concerns because you know the CEOs of both those companies have expressed uh a desire to regulate or ban open models, uh, or at least nerf them, uh nerf whichever models that are available publicly.
00:10:01.039 --> 00:10:03.279
Um, because there's a real competition.
00:10:03.279 --> 00:10:05.440
In this case, it's kind of complimentary.
00:10:05.440 --> 00:10:19.840
Um Nvidia, yes, they sell an enormous amount of uh of uh cards and chips to uh companies like NVIDIA like OpenAI and Anthropic, but they're loaning them a lot of money as well and financing a lot of that.
00:10:19.840 --> 00:10:21.360
So they don't have cash in hand.
00:10:21.360 --> 00:10:39.600
A lot of their cash in hand is selling these chips to servers, uh server companies that are you know producing servers or other companies that are uh you know building their own AI infrastructure because the cost of these uh these closed uh uh closed companies or uh or closed model companies are pretty high.
00:10:39.600 --> 00:10:42.559
So, you know, that's where they're getting their cash up front from.
00:10:42.559 --> 00:10:47.759
And honestly, it it's best for them to continue uh continuing encouraging people to do that.
00:10:48.320 --> 00:10:48.799
100%.
00:10:48.799 --> 00:10:49.519
100%.
00:10:49.519 --> 00:10:53.039
We have more uh what oh go ahead, go ahead.
00:10:53.039 --> 00:10:53.360
Sorry.
00:10:53.600 --> 00:11:02.799
I was gonna say this actually is a segue for another story you were gonna talk about later on, but I actually was thinking that maybe we should move that one here because that would be a good conversation to have.
00:11:02.799 --> 00:11:06.559
Uh the one about the one about cutting finance.
00:11:07.200 --> 00:11:08.480
Yeah, yeah, yeah, right, right, right.
00:11:08.480 --> 00:11:12.000
Okay, so yeah, so this is we were gonna cover this a little bit later, but I agree.
00:11:12.000 --> 00:11:14.879
Let's just go ahead and move it up because it covers NVIDIA, talked about NVIDIA.
00:11:14.879 --> 00:11:25.840
So one of the big things that's come out of you know all of this bait data center building is uh essentially a toxic amount of risk and debt associated with building large data centers.
00:11:25.840 --> 00:11:37.440
And and um, you know, what what what we've been seeing now in the news is a lot of the large financiers uh trying to, you know, to the extent possible transfer or limit that amount of risk.
00:11:37.440 --> 00:11:48.320
So NVIDIA you know had originally has originally pledged just just boat tone, just load boatloads of money to help get data centers built, right?
00:11:48.320 --> 00:11:54.000
Again, if they're selling axes and shovels, you can only help if there's more axes and shovels out there, right?
00:11:54.000 --> 00:12:04.879
So um, but recently Nvidia's NVIDIA is actually scaling back the amount of uh financial guarantee for an Ohio data center that OpenAI is building.
00:12:04.879 --> 00:12:11.120
So they had initially pledged 250 billion, which again, these are just astronomical numbers, right?
00:12:11.120 --> 00:12:15.440
Uh they've they've more let more than halved it, right, to under 120 billion.
00:12:15.440 --> 00:12:22.080
So they're only backing the first phase of the build, and then about half of what's proposed.
00:12:22.080 --> 00:12:27.679
And then basically other companies will have to come out, uh come out and finance the rest.
00:12:27.679 --> 00:12:50.000
You know, OpenI will have to pursue financing elsewhere, which is you know uh uh BlackRock and like Goldman Sachs and all of these, all of these uh other financial companies which are basically using your pensions to find uh to finance these data centers, are uh you know having to step up if they if this data center wants to get built.
00:12:50.000 --> 00:13:00.480
And this is this is you know, you you look in the news, this is happening all over the place, but this is one of the biggest news uh news stories about it that's come out uh within the last month.
00:13:01.039 --> 00:13:05.200
Yeah, and uh seguing uh segueing to the next story.
00:13:05.200 --> 00:13:15.200
Um uh one thing I wanted to bring up, and I um I yeah, we skipped over it uh because we haven't had a news uh uh a news episode since then.
00:13:15.200 --> 00:13:19.759
So everyone's probably heard of this story, but I'm gonna kind of dig into it from a different angle.
00:13:19.759 --> 00:13:27.919
Uh the open AI hugging face incident, and also like the other incidents with anthropic and uh and uh um and meta.
00:13:27.919 --> 00:13:37.039
So uh by now, most of you who are probably watching this uh uh have heard about the open AI hugging face, you know, agent breach.
00:13:37.039 --> 00:13:52.960
And um, so I'm gonna discuss that a little bit, and we probably will have a follow-up episode digging into it deeper from a technical perspective, because I do think there's there is a certain amount of mainstream media kind of FUD out there, like um, you know, kind of like things are just you know sensationalized.
00:13:52.960 --> 00:14:02.960
Um but essentially what what happened is um uh around uh like basically OpenAI was running a test with uh with one of their models.
00:14:02.960 --> 00:14:08.559
And it was supposed to be a sandbox test um uh inside of a lab.
00:14:08.559 --> 00:14:16.960
And it it was basically tune tuning down the controls on uh and the guardrails on the these models and then telling them, hey, we're gonna gamify hacking.
00:14:16.960 --> 00:14:19.120
We want to test how how well they hack.
00:14:19.120 --> 00:14:24.799
So they basically set up um set up a uh uh a hacking test.
00:14:24.799 --> 00:14:34.000
Um and you know, if you've read the news, you've you'll heard here like, oh, there was a great escape where it went out to the internet and it hacked Hugging Face.
00:14:34.000 --> 00:14:40.000
Um, yes, it did go out to the internet and these agents did hack uh Hugging Face.
00:14:40.000 --> 00:14:47.120
Um, and uh, but there are some details that have been acknowledged publicly uh that I would also like to point out.
00:14:47.120 --> 00:14:58.240
Um, so a lot of these different companies that were uh, you know, and later on, by the way, um Anthropic, Meta came out with their own disclosures that they had similar things happen that were less impactful.
00:14:58.240 --> 00:15:08.960
So I there's a couple of things I wanted to kind of go over as far as this news story uh to kind of uh you know dispel some of like the sensationalized news because it's been out there.
00:15:08.960 --> 00:15:18.320
Uh a lot of like the news stories I saw were pretty inaccurate, even by hugging uh like OpenAI's uh own uh like report that they put publicly.
00:15:18.320 --> 00:15:25.039
Uh some of the mainstream news uh stories I heard was these agents just broke out and started hacking arbitrarily.
00:15:25.039 --> 00:15:30.480
Um, first of all, they then they they just chose to hack and thought it up there on their own.
00:15:30.480 --> 00:15:32.080
They were actually instructed to hack.
00:15:32.080 --> 00:15:34.879
So that is verified by OpenAI in their own report.
00:15:34.879 --> 00:15:36.480
It was a hacking test.
00:15:36.480 --> 00:15:42.960
Um, and there was a gateway to the internet, um, which was overlooked uh basically through a proxy.
00:15:42.960 --> 00:15:58.799
Um they were all all these different companies that were having that disclosed later on that they were uh this happened actually uh admitted that they were using the same sandboxing company that helped them benchmark and um that some of the controls that were in place were not as uh tightened as they thought.
00:15:58.799 --> 00:16:08.080
The other issue um I that again acknowledged by OpenI was that there was not um the monitoring in place was somewhat lacking.
00:16:08.080 --> 00:16:18.639
So uh when this these agents went out, they thought they basically hacked um uh Hugging Face thinking it was part of the test that, you know, like, okay, maybe we'll get some points going and doing this.
00:16:18.639 --> 00:16:26.799
And they were these different agents in the um from these different models were basically able to communicate through like a uh side channel that shouldn't have existed, but it did.
00:16:26.799 --> 00:16:35.279
And uh so they they thought they were still playing a game, and um they went out and tried to play the game on a re in a real environment.
00:16:35.279 --> 00:16:45.279
Uh when that hack happened, Hugging Face was aware of it and was triaging it before OpenAI even knew anything happened because of that lack of monitoring.
00:16:45.279 --> 00:16:52.240
So those are some of the details that I think that the news stories have missed, but have been admitted by uh OpenAI.
00:16:52.240 --> 00:16:58.480
And there's there's a lot of like kind of sensationalizing of it, uh both from OpenAI and anthropics point of view.
00:16:58.480 --> 00:17:03.440
And that'll kind of segue to next story a little bit when I I get to that.
00:17:03.440 --> 00:17:09.200
But um there is some important things to look at uh that you know, that have to be touched on.
00:17:09.200 --> 00:17:12.640
And if you want you, you know, to hear OpenAI's side of the story.
00:17:12.640 --> 00:17:22.240
Uh, they actually have a public disclosure report that they released that's it wasn't verified by any third parties, it's just what they released uh publicly, plus hugging uh hugging face is one.
00:17:22.240 --> 00:17:24.720
So I'm pulling details out of some of these.
00:17:24.720 --> 00:17:28.400
Um and there's a black hat talk uh done by OpenAI.
00:17:28.400 --> 00:17:31.279
So that's their side, just bear that in mind.
00:17:31.279 --> 00:17:34.079
Um, but I I the story did happen.
00:17:34.079 --> 00:18:03.279
And the uh, you know, so I'm not I probably am not telling anyone, you know, a couple months later that this, you know, something they haven't heard, except for the fact that there are a lot of details that are missed in the uh in the public disc uh in the public uh you know uh mainstream news, uh, news outlets that I kind of wanted, you know, I wanted to focus on what by saying that it wasn't like AGI formed and they did something wild and crazy because, you know, what and they were just testing rendering art or something.
00:18:03.279 --> 00:18:08.160
This was actually part of what they were told to go and do, and they were just thought they were playing a game.
00:18:08.160 --> 00:18:11.359
Um, so that is very, very important to touch on.
00:18:11.359 --> 00:18:23.839
But it sort of segues to my uh uh, you know, my next story, which was about like how it's kind of segueing into uh to uh legislation being pushed by everybody.
00:18:23.839 --> 00:18:31.039
Now uh uh I don't know if anyone's heard uh oh actually before I go into the next story, is there anything you want to discuss on this one?
00:18:31.039 --> 00:18:33.279
I I kind of am like jumping all over the place.
00:18:34.000 --> 00:18:42.079
So we did actually cover the initial uh story um on our last in in our August news, but it was brand new at the time.
00:18:42.079 --> 00:18:45.759
So obviously a lot more details have come out after the fact.
00:18:45.759 --> 00:18:48.799
Uh stuff that wasn't known and has now been known.
00:18:48.799 --> 00:18:59.279
And and of course, we've got all the article notes, we'll go into the show notes so people can check, uh you know, can catch up on a lot of this uh stuff that Catherine's talking about.
00:19:00.000 --> 00:19:00.880
That's it.
00:19:01.200 --> 00:19:16.480
Yeah, and I was gonna say there's a very good uh uh uh opinion piece or paper uh done based on on um that we'll throw that in the show notes as well, based on uh the analysis by Gary Marcus and Zach Corman.
00:19:16.480 --> 00:19:26.799
Zach Corman previously was interviewed on this show, um, and uh uh he's a very pro-AI, uh, but he's not working at one of the big like OpenAI and Anthropic.
00:19:26.799 --> 00:19:32.079
Gary Marcus is actually interesting because he's a long-standing critical voice on Frontier AI.
00:19:32.079 --> 00:19:38.480
But they both did like kind of a security analysis based on some of the things that were uh admitted by OpenAI and gave their thoughts.
00:19:38.480 --> 00:19:40.799
So I I think that's an interesting angle.
00:19:40.799 --> 00:20:05.279
We're all here, uh, you know, I I've read some of the very ridiculous like mainstream media takes on this, and it, you know, it's been sort of uh it's like some people it it felt like at times, and this is my own opinion, uh, that you know, uh people saw Terminator and kind of thought it was a documentary based on the way that some of these uh articles have missed some of the really important details.
00:20:05.839 --> 00:20:06.640
It's not too late.
00:20:06.799 --> 00:20:09.359
Um, but that segues to my other, my other story.
00:20:09.359 --> 00:20:18.880
Um, since all that happened, uh I mean, even before the hugging face incident, uh Anthropic and and OpenAI were pushing for regulation.
00:20:18.880 --> 00:20:34.720
Um, if you look kind of like peel back the layers of why they're pushing for legisl legislation, yes, they're conceding like, yeah, you can, you know, third parties can come in and r review what we're doing, but there seems to be a very strong um push to ban open models.
00:20:34.720 --> 00:20:45.200
Um and this the loudest people pushing for that are the people that, you know, tend to profit the most from that, um, closed models, uh, frontier model uh providers.
00:20:45.200 --> 00:20:54.160
I think what they're b what they're doing as far as like the kind of models they're provide uh creating are great, but it it it uh it does lead to my skepticism.
00:20:54.160 --> 00:20:57.839
And this will be another episode, I think that we could have a conversation.
00:20:57.839 --> 00:21:06.079
But of course, with all of that fear, uncertainty, and doubt being pumped out there, now there are legislators uh who are pushing for some very extreme things.
00:21:06.079 --> 00:21:25.519
And one of the things that um came up was uh Sanders uh wanting uh Bernie Sanders, uh Senator Bernie Sanders and Representative Greg Casir, uh Cassair, I hope I'm pronouncing his name, are trying to uh introduce something called the Ban Artificial Superintelligent uh Intelligence Act.
00:21:25.519 --> 00:21:32.400
So what that would do is would it would put extremely intelligent AI, um, and the wording is really terrible.
00:21:32.400 --> 00:21:45.680
I I read the the the the notes on the bill and everything, and it was it's it basically says that it it defines superintelligence so broadly, it's basically AI matching human cognitive performance across multiple tasks.
00:21:46.000 --> 00:21:48.799
So what about CCIE level?
00:21:48.799 --> 00:21:52.480
What about CCIE level intelligence across multiple tasks?
00:21:59.039 --> 00:22:00.880
I mean, if certain Certain cognitive tests.
00:22:00.880 --> 00:22:08.480
If we are we talking about memory, well, GP Chat GPT 3.5 was probably had a better memory than a normal human being.
00:22:08.480 --> 00:22:13.359
Um, and what kind and we need to find um matching human cognitive performance.
00:22:13.359 --> 00:22:14.240
What human?
00:22:14.240 --> 00:22:16.559
Because no insult to the human race.
00:22:16.559 --> 00:22:19.839
We have some smart ones, we have some not so smart, we have some really brilliant ones.
00:22:19.839 --> 00:22:20.960
There's a variation.
00:22:20.960 --> 00:22:25.519
Yeah, like the dumbest person you know, or the smartest person you know.
00:22:25.519 --> 00:22:28.240
Uh it it which cognitive tasks.
00:22:28.240 --> 00:22:59.680
So what it would essentially do is it would take anything that's a super uh super intelligent AI, which broadly defined where it is right now, basically every model you use, like uh like Chat GPT, like major models, Chat GPT, uh Fable would probably fit under that because they, you know, they can perform a cognitive, like probably perform uh basic programming without having to like, you know, or like uh, you know, creating a video game on a first pass better than a human would.
00:22:59.680 --> 00:23:04.559
I mean, it's it's still buggy and requires multiple pass, like a normal human would as well.
00:23:04.559 --> 00:23:06.799
But, you know, what's the benchmark?
00:23:06.799 --> 00:23:39.599
What we would essentially be left with is like the most barebone uh gen AI, where we would be so all the slop you see, like the generative art that looks the same and we all hate uh or the really crappy songs that sound the same uh coming out of like uh certain models, we'd keep we'd get to keep that, but we wouldn't get to keep the stuff that we use for uh medical research, for uh programming, for uh for uh for like the the kind of like research that will like actually help us from a scientific or standpoint of view.
00:23:39.599 --> 00:23:45.920
Um and so that yeah, and if you are found having superintelligent AI, now now here's the crappy part.
00:23:45.920 --> 00:23:52.079
It it essentially puts it in the same bracket as assembling nuclear weapons or weapons of mass destruction.
00:23:52.079 --> 00:24:01.440
So if you're found downloading like an open AI model from or no uh open uh uh source model from I have to say open source model from source model.
00:24:01.680 --> 00:24:01.920
Yeah.
00:24:02.480 --> 00:24:16.240
Uh like uh like uh Quen uh or uh uh uh or uh Deep Seek, you would essentially prison uh for uh basically violating that act.
00:24:16.720 --> 00:24:17.759
It's a non-starter.
00:24:17.759 --> 00:24:20.000
I mean, there's there's not enough explained.
00:24:20.000 --> 00:24:31.200
One little thing you put in there that you uh it wasn't mentioned is that it also specifies uh this you know the definition includes a system that will resist shutdown commands.
00:24:31.200 --> 00:24:34.480
So again, very broadly defined.
00:24:35.599 --> 00:24:39.839
I guess Windows 11 good gets right into it because I I've I've I've tried to be like, shut down, shut down, shut down.
00:24:39.839 --> 00:24:40.319
Am I always gonna do that?
00:24:40.319 --> 00:24:44.000
Please shut down when I was using it and it it just resisted.
00:24:44.559 --> 00:24:45.759
Yeah, that's the thing.
00:24:45.759 --> 00:24:56.240
It's too broad, but I do of all the the ridiculousness in this bill, I'm looking at that one like, all right, at least I could see where a person could reasonably make an argument that that's a thing.
00:24:56.240 --> 00:25:09.119
Like, you know, hey, an AI that that doesn't allow itself to be shut down could be problematic in the right circumstances, but like the whole thing's a non-starter, it's just too broad, it's too vague.
00:25:09.119 --> 00:25:11.119
The people the wrong people wrote it.
00:25:11.119 --> 00:25:21.119
Um yeah, that or they didn't they didn't seek the correct technical uh people to help them author this bill, I suppose, to be useful.
00:25:21.599 --> 00:25:23.680
I mean, I I agree with you on that one, though.
00:25:23.680 --> 00:25:38.319
The part where um, you know, have it like I I I don't mind saying like if you know we should legislate something where uh where we have uh essentially controls in place where if a model needs to have its plug pulled immediately, like there's an override.
00:25:38.319 --> 00:25:49.599
But um I yeah, like I I feel like this bill is gonna people are gonna point at it and say if it doesn't pass, we can at least pass something less severe and pass something still not great.
00:25:49.599 --> 00:25:50.880
Yeah.
00:25:50.880 --> 00:26:05.519
If anyone who's watching this uh this show for long enough since I've joined, you guys, uh if you've listened and my opinions on AI, which are again my opinions, you know I'm not like pro-AI Kool-Aid by any means.
00:26:05.519 --> 00:26:15.599
Um uh, but I I do think ban, you know, I I think that where we're going with legislation with this could potentially end up disastrous.
00:26:15.599 --> 00:26:29.119
Um and the other thing it also calls for is stopping all AI research temporarily while they form a new cabinet and and and system basically uh in place to uh to review uh review the AI AI models.
00:26:29.440 --> 00:26:29.599
Yeah.
00:26:30.160 --> 00:26:31.680
Yeah, that takes years.
00:26:31.680 --> 00:26:50.000
Uh so essentially US would be put on freeze for any like research development, like like people who do medical research or scientific research, mathematicians, uh like, you know, just recently somebody won the R Nobel Prize or uh for a math problem they helped had AI help them solve.
00:26:50.000 --> 00:26:52.319
Uh multiple AI models help them solve.
00:26:52.319 --> 00:27:17.839
Um, all of the research that we're doing towards science, the good things that I I see AI being used for, uh, or even AI being used for potentially like detecting like zero days, defenses, like cybersecurity defenses, uh other things like that, all of that is basically put on hold while the rest of the world moves on and continues to advance while we we build essentially like a regulatory infrastructure within our government, which will take forever.
00:27:18.160 --> 00:27:20.240
Yeah, I mean, I agree.
00:27:20.240 --> 00:27:21.920
Uh this is not starter.
00:27:21.920 --> 00:27:25.119
I don't I don't necessarily think it's a I don't know.
00:27:25.119 --> 00:27:30.319
I've I I keep hearing this, especially from the administration, the specter of, oh, we have to beat China.
00:27:30.319 --> 00:27:31.680
It's like another space race.
00:27:31.680 --> 00:27:41.279
And I I I don't think that I don't think just saying someone else will do it first is a good enough answer to why we shouldn't do something like in terms of controls.
00:27:41.279 --> 00:27:45.440
But I think this specifically is just right off the reservation, right?
00:27:45.440 --> 00:27:48.160
It's just it's it's too it it's not right.
00:27:48.160 --> 00:27:49.680
But what can we do?
00:27:49.680 --> 00:27:50.160
I don't know.
00:27:50.799 --> 00:27:52.720
It's not necessarily China, by the way.
00:27:52.720 --> 00:28:00.880
It's more of the fact that like the advances in medicine, research, things like that will continue around the world, it just won't be here.
00:28:00.880 --> 00:28:11.759
And if people care about that from a perspective of, well, and again, it's like we're not of all of our listeners or listeners are necessarily in the US, so respect there.
00:28:11.759 --> 00:28:36.480
But like uh in for those that are located in the US, like if other countries are able to beef up their offensive and defensive cybersecurity resources and we aren't, we're uh, or they get to move ahead in medicine or science and we aren't, um, yeah, that can affect things like economics, uh economics, you know, health safety, our own cybersecurity safety, infrastructure safety.
00:28:36.480 --> 00:28:39.680
And and that's where I see that being an issue.
00:28:39.680 --> 00:28:42.319
It's not necessarily like one c we gotta beat one country.
00:28:42.319 --> 00:28:46.480
It's more of just the fact that we need to probably keep up with where the rest of the world is.
00:28:47.519 --> 00:28:59.359
Yeah, I just keep hearing I just keep hearing this kind of mutually assured destruction type of of rhetoric around AI development generally, just out there.
00:28:59.359 --> 00:29:08.799
And I'm I I'm not I'm not sure that type that that uh doctrine is you know a good one to operate under.
00:29:09.599 --> 00:29:33.440
No, no, like the people who are like being like, oh, it's gonna build nuclear weapons or self-replicate itself to every internet, like like I I'm sorry, but if you think that like that uh you know the people there are people who literally I I've gotten to arguments with them who actually think that like frontier models like uh Mythos or uh Ask uh Astra can like self-replicate themselves into your like consumer computer.
00:29:33.440 --> 00:29:47.359
I'm like, if that was the case, then why are we spending so much money on GPUs if it could just like replicate replicate itself into your like MacBook Neo running like a no graph specialized graphic uh graphics card and eight gigs of RAM?
00:29:48.000 --> 00:29:51.039
Yeah, I want it to run on my toaster oven, please.
00:29:51.440 --> 00:29:55.920
Yeah, why are we building data centers if we can all just run it from our home computer?
00:29:55.920 --> 00:30:03.680
Um Yeah, there there's a bit of scientific like sci-fi that's kind of like I think spun people up here.
00:30:03.680 --> 00:30:18.000
And that's that's the thing that's gotten me a little uh it's it's hard because Yeah, it's hard to be having these conversations with folks who are like think it's going to be like uh the next nuclear weapon and um and they're not very technical.
00:30:18.480 --> 00:30:27.119
Well, I mean, to be fair, the media doesn't do a particularly great job themselves or others, you know, of of may of of de-escalating that rhetoric, right?
00:30:27.119 --> 00:30:28.000
So anyway.
00:30:28.400 --> 00:30:58.720
That's why like when I was talking about the hugging face story, you know, in this episode, I you know, I wanted to talk about the stuff that wasn't like as front-facing in the news because uh I I feel like a lot of people are operating and or fearful under the fact that like you know, a lot of the details have been missed, but also there is some legitimate um anger or uh public distrust or just general dislike of AI, which there are a lot of valid reasons.
00:30:58.720 --> 00:31:13.119
I mean, again, watching if you've been watching me on this show enough, you know that I'm not like miss drink the Kool-Aid, I love AI, it's going to be like it's gonna make me a sand bake bake me a cake and make me a sandwich, and I do it for every single thing in my life.
00:31:13.119 --> 00:31:22.400
But I I I again I I consider myself a AI realist with like what it what its capabilities are, and it's not like gonna end the world.
00:31:22.400 --> 00:31:33.039
Unless we like, you know, uh you know, build so many data centers that it's uh it sucks up uh every natural resource, but that's a different, like not like it's not gonna launch the nukes, basically.
00:31:33.440 --> 00:31:45.440
That's not the one that uh Asimov or uh Clark or anybody kind of foresaw was was just building the AI being the the cause of the Kardashev scale that causes us to go extinct.
00:31:45.440 --> 00:31:46.400
Um yeah.
00:31:47.039 --> 00:31:56.240
No, trust me, human humans will might find a way to destroy mankind before before uh uh a machine probably will mess us mess us up.
00:31:56.240 --> 00:31:59.200
Uh and one more story I wanted to cover.
00:31:59.200 --> 00:32:00.960
This one's a little happier of a story.
00:32:00.960 --> 00:32:08.559
So uh AI, uh OpenAI uh just shipped GPT 6, which is Astra, um which is actually really good.
00:32:08.559 --> 00:32:15.680
It's it's uh I don't know if anyone else has played with it, but it was uh just shipped out like um about 10 days ago.
00:32:15.680 --> 00:32:24.880
It really did step up, like there's a very clear difference uh from what I've seen as far as like um as far as like quality and content.
00:32:24.880 --> 00:32:36.880
Uh so they uh they claim uh like OpenAI claims like uh a 0% rate of exceeding extended uh scope versus like 48% for GPT 5.6.
00:32:36.880 --> 00:32:41.200
I'm I'm a little skeptical of those numbers from what I've I've been doing testing out uh testing out.
00:32:41.200 --> 00:32:43.200
The hallucinations, I I can definitely see.
00:32:43.200 --> 00:32:51.920
So hallucinations are down to 2% from 9.4 uh in uh in um you know from uh GPT 5.6.
00:32:51.920 --> 00:32:55.279
Uh I I also like tested it this weekend.
00:32:55.279 --> 00:33:06.079
I I just dug in on like codex with uh with uh with uh five dot with uh Astra because I was like, I saw so there's this real this really cool guy, um, his name is Dave Kennedy.
00:33:06.079 --> 00:33:11.440
He runs, he actually owns a company, Trusted Sec, uh really, really good cybersecurity gentleman.
00:33:11.440 --> 00:33:18.000
Uh and he like was testing out Astra like 10 days ago, and he's like, I just had created this first person shooter game.
00:33:18.000 --> 00:33:21.519
It actually looked really nice uh in like a day with Astra.
00:33:21.519 --> 00:33:22.559
Like it's really good.
00:33:22.559 --> 00:33:26.240
So I decided to put my own test forward and see if I could do that.
00:33:26.240 --> 00:33:31.119
And I actually created two video games over uh the weekend that actually aren't bad.
00:33:31.119 --> 00:33:44.799
So if anyone like I'm just gonna show as an example, but this is something like I tried on 5.6 and I I got like the bl like the you remember the old like uh Sega Genesis blocky characters like that, like we thought like were really great in the 90s?
00:33:44.799 --> 00:33:45.920
I got that from 5.6.
00:33:45.920 --> 00:33:54.640
This is uh just a little sh uh share, but like this is just uh I'm gonna share like this is not with without like much uh badgering.
00:33:54.640 --> 00:33:59.759
I wanted a Final Fantasy III sort of a sort of uh style game.
00:33:59.759 --> 00:34:07.200
So uh this was within like a couple of like like an hour or two of fiddling.
00:34:07.200 --> 00:34:18.800
I I basically, you know, got a uh a game together where I could like um and it's like a browser-based game uh where I could like, you know, and it's very similar.
00:34:18.800 --> 00:34:20.159
It was not that bad.
00:34:20.159 --> 00:34:27.119
Um and then so I decided, okay, I'm gonna push it a little bit further, like 32-bit game or 16-bit, 32-bit games, that's one thing.
00:34:27.119 --> 00:34:33.840
Let me try like again, nostalgia, old Sierra game style, click and shoot games or click and uh interact games.
00:34:33.840 --> 00:34:35.199
So I decided to try to give it a game.
00:34:35.199 --> 00:34:42.800
Yeah, so uh because again, this is just me copying what um what uh Dave Kennedy did.
00:34:42.800 --> 00:34:46.320
Uh so I tried to ru uh create this.
00:34:46.320 --> 00:34:50.559
So I created this over you know 48 hours.
00:34:50.559 --> 00:34:53.840
It's like got cinematic scenes, other things like that.
00:34:53.840 --> 00:34:55.360
And I was just playing around.
00:34:55.360 --> 00:34:58.000
Didn't take much work to do.
00:34:58.000 --> 00:35:04.159
Um and just other things like I coded some scripts with it, really great right out of uh out of the bat.
00:35:04.159 --> 00:35:08.000
Uh I you know played around with some things.
00:35:08.000 --> 00:35:10.719
Again, it's done a pretty good job so far.
00:35:10.719 --> 00:35:25.119
As far as where it ranks against uh Fable, I haven't tested that yet, but I it's if anyone wants to uh try it out, like I that like Final Fantasy style game, I did that on the $20 a month like regular Chat GPT membership.
00:35:25.119 --> 00:35:29.119
I didn't even record it didn't even take a hit past that.
00:35:29.119 --> 00:35:33.599
Um so it does seem to be pretty efficient as far as uh as far as usage.
00:35:33.920 --> 00:35:34.480
Very cool.
00:35:34.480 --> 00:35:35.519
Very cool.
00:35:35.519 --> 00:35:40.320
I did uh this is bit a bit ago now, maybe a month or two.
00:35:40.320 --> 00:35:52.880
I did the uh cloud the cloud uh a Claude Cloud Bootcamp with Andrew Brown, and we did uh we did uh build an agent that can actually play a multi-user dungeon text-based adventure game and actually go and play it.
00:35:52.880 --> 00:36:02.880
You had to like pro essentially build the agent and then give it the tooling to go, you know, explore and get gear and and whatnot within the confines of a multi-user dungeon.
00:36:02.880 --> 00:36:04.800
It was it's definitely come a long way.
00:36:04.800 --> 00:36:06.639
It's pretty interesting stuff.
00:36:07.039 --> 00:36:09.280
Yeah, it it it definitely has.
00:36:09.280 --> 00:36:12.159
I didn't think I would be able to like ever be able to build something.
00:36:12.159 --> 00:36:14.639
I'm again not a video game designer.
00:36:14.639 --> 00:36:31.119
Um not a like this is just me like going off of nostalgia vibes and and kind of like pointing towards something I I knew as a kid, but you know, two video games on a weekend that are you know, one of them's like 10 hours of gameplay and the other's maybe two hours.
00:36:31.119 --> 00:36:41.360
But it it if with somebody who's actually skilled at making video games, writing stories, things like that, uh in their hands they could probably make something pretty decent with some.
00:36:41.360 --> 00:36:48.320
And I yeah, of course, I had to feed it some uh test art to base it off, base it off of, but it was pretty accurate.
00:36:49.039 --> 00:36:50.639
Very cool, very cool.
00:36:50.960 --> 00:36:52.320
All right, well, good news.
00:36:52.320 --> 00:36:56.559
For once we don't end an in an AI fueled news episode on a down note.
00:36:57.679 --> 00:37:10.159
Yeah, so and I was gonna say, uh um uh as far as uh uh Astra's concerned, uh it you know, it does not appear to be AGI.
00:37:10.159 --> 00:37:15.840
Uh I had some people actually like uh claim that it was, and I'm just like people saying out there all the time, yeah.
00:37:15.920 --> 00:37:16.400
AGI.
00:37:16.639 --> 00:37:18.239
Yeah, every new model's AGI.
00:37:18.800 --> 00:37:20.159
Yeah, we're there, guys.
00:37:20.159 --> 00:37:20.960
We're there.
00:37:20.960 --> 00:37:22.079
Anyway.
00:37:22.079 --> 00:37:23.360
So all right.
00:37:23.360 --> 00:37:24.800
Well, we'll go ahead and cut it there.
00:37:24.800 --> 00:37:30.480
Uh thanks for sticking around, and uh we will see you all on the next news episode.
00:37:30.480 --> 00:37:35.280
Uh this has been uh Cables Clouds Fortnite the news, and we'll see you next time.