WEBVTT
00:00:00.179 --> 00:00:28.114
So Jennifer, one of the fun sites on the internet that we'll be talking about a little bit today is Kickstarter, which is the crowdfunding site, and it has a tagline/prompt of"Bring a creative project to life." this is, I will note, the last time ever that we're doing one of these cold opens with a prompt, but we are doing it, and we are using Kickstarter, and I would like to ask you, what creative project would you like to bring to life?
00:00:28.356 --> 00:00:37.637
well, I already did my most you know, favorite creative project when I created, some knit hats out of the fur of my giant Newfoundland dog.
00:00:38.087 --> 00:00:41.936
So you kind of feel like, oh, maybe I peaked in terms of creativity.
00:00:44.097 --> 00:00:44.356
Other
00:00:44.421 --> 00:00:45.021
are amazing.
00:00:45.070 --> 00:00:45.881
have seen them.
00:00:45.881 --> 00:00:46.750
They are amazing.
00:00:46.765 --> 00:00:47.256
Yeah.
00:00:47.856 --> 00:00:51.615
Other people hope I don't go down that creative path ever again.
00:00:52.006 --> 00:01:03.718
But the thing I've actually been thinking about is, there are a lot of people out there who have had sort of, you know, great educations, but kinda limited, like focused on only computer science or engineering or that sort of thing.
00:01:04.097 --> 00:01:14.552
And, you know, they wanna like know more about Western civilization and the great books, but they either didn't have a chance to read them or weren't able to like fully appreciate them when they were just in middle school or high school.
00:01:15.052 --> 00:01:30.581
And my idea is, you know, there's a lot of people out there who are English professors, you know, who are experts in literature, and kind of connecting the people who want to read with the people who have read and thought about the books in sort of like a book group kind of fashion.
00:01:30.581 --> 00:01:40.171
So not a lecturer sort of thing, but like invite a professor to your book group to just be like a friend, part of the conversation, just talk about some of these great books with you.
00:01:40.451 --> 00:01:55.043
I think it's, fun for the, professors to maybe make a little extra money and really valuable for people who are serious about books and about learning about, you know, literature and our tradition and stuff to be able to have, more expertise in a fun situation.
00:01:55.043 --> 00:01:59.983
So that's something I've been thinking about as kinda like a cool sort of, business.
00:02:00.329 --> 00:02:01.450
That's very cool.
00:02:01.590 --> 00:02:07.150
That's, I was expecting a, a more joking answer, but that's that's a very, very cool idea.
00:02:07.150 --> 00:02:08.060
I appreciate that.
00:02:09.272 --> 00:02:12.712
What, what would be your creative project that you wanna bring to life?
00:02:12.758 --> 00:02:19.418
Oh my gosh, I was thinking through this, in terms of I have a long list of creative projects, and so it's like which one do I wanna talk about?
00:02:19.808 --> 00:02:27.723
I have been seriously thinking about, and I think this would be fun to do, to write a novel that is, uh, uh, reflective of the times that we live in.
00:02:27.943 --> 00:02:29.343
There's so much stuff going on.
00:02:29.413 --> 00:02:35.993
I, I have an idea for a, novel that I guess comically comments on, on the world that we live in today.
00:02:36.973 --> 00:02:37.394
I,
00:02:37.400 --> 00:02:47.337
I think that the world could use a little bit of humor while not like, people turn, having to turn a blind eye in order for us to have fun in what is now the real world.
00:02:47.337 --> 00:02:48.807
So I like that idea.
00:02:49.497 --> 00:02:52.578
Um, do you wanna say a little more about how the novel's gonna go?
00:02:53.174 --> 00:02:54.614
I, I, I'm afraid to.
00:02:56.872 --> 00:03:08.066
So, I think, uh, for people who follow me and my writing and everything, I think they would recognize some of the themes, though I might present them in a slightly different form than, than I normally do with, my writing
00:03:08.098 --> 00:03:08.579
Uh-huh.
00:03:08.959 --> 00:03:10.799
I think that the world is waiting
00:03:12.031 --> 00:03:29.251
Excellent Hello, and welcome to Control Alt Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
00:03:29.341 --> 00:03:45.687
It is May the 21st, 2026, and this week we are talking about AI in Africa, online speech choke points, regulators using VPNs, and just how much you're allowed to post on X these days.
00:03:46.193 --> 00:04:03.123
I am Mike Masnick, the founder and editor of Techdirt, with special guest host Jennifer Granick, a civil liberties lawyer previously with the ACLU and Stanford Law, and author of the wonderful book, American Spies, all about the modern surveillance society that we live in.
00:04:03.633 --> 00:04:20.891
I will note this is the last week of Ben's well-earned paternity leave, and he and I will both be back next week, which raises a few important things that are worth mentioning that if you've been listening to the podcast, you should already know, but I feel the need to remind you of them.
00:04:21.071 --> 00:04:22.254
There are changes afoot.
00:04:22.449 --> 00:04:26.189
As mentioned, we went through the last of the opening prompts.
00:04:26.459 --> 00:04:27.480
We are getting rid of that.
00:04:27.569 --> 00:04:28.990
We have run out of prompts.
00:04:29.029 --> 00:04:30.259
We have exhausted that.
00:04:30.819 --> 00:04:40.403
if you are a subscriber to the new Patreon, which you should be, and you can find that at patreon.com/ctrlaltspeech, C-T-R-L-A-L-T speech.
00:04:40.434 --> 00:04:50.307
Uh, if you a subscriber there, you can now access the Control Alt Speech Plus podcast feed.
00:04:50.798 --> 00:05:06.639
If you go to the page and if you view the membership tab, you can get the new RSS feed, which will be important starting next week because part of the podcast will only be available to those who subscribe and support us that way.
00:05:06.810 --> 00:05:11.855
We also have the free podcast, which will be slightly shorter and a little bit different.
00:05:12.266 --> 00:05:29.088
So if you wanna get access to the full continuing podcast like you've had it all along, please go support us, subscribe at the Patreon, and you can go find that RSS feed now and subscribe to it so you'll be ready next week when the episode changes go into effect.
00:05:29.309 --> 00:05:33.011
There should be nothing in that feed right now because we haven't done that.
00:05:33.141 --> 00:05:34.531
It will start next week.
00:05:34.860 --> 00:05:40.338
But you can subscribe now, and you can get your access for starting next Thursday.
00:05:40.338 --> 00:05:47.500
I'll also note that this is the last week to get in at the special founder discount rate for the Patreon.
00:05:48.021 --> 00:05:51.774
once Ben is back, we will still have the offering, but prices will go up.
00:05:51.845 --> 00:05:56.560
So if you wanna be a founder supporter, please do that now.
00:05:56.860 --> 00:06:03.579
we also have a post up on the Patreon right now asking for ideas on our new cold open.
00:06:03.608 --> 00:06:06.819
How do we want to replace that prompt that has grown so tired?
00:06:07.245 --> 00:06:15.723
so you can weigh in and help us figure out what we are going to say and how we are going to open the podcast test, so you can go check it out and share your thoughts.
00:06:16.163 --> 00:06:28.324
And starting tomorrow, we'll be posting the first suggestion box post, for Patreon supporters, where founder-level subscribers can submit links to stories that they would like us to cover.
00:06:28.673 --> 00:06:33.994
So keep an eye out for that starting tomorrow if you are supporting at the founder level.
00:06:34.024 --> 00:06:36.113
So please check out the Patreon.
00:06:36.204 --> 00:06:37.884
We're excited about this.
00:06:37.884 --> 00:06:42.223
This'll be a little bit of an experiment, and we're sort of happy to see what happens there.
00:06:42.613 --> 00:06:47.144
But with that very long intro, let us get to our stories.
00:06:47.454 --> 00:06:53.334
We have, Jennifer, I think you're going to take our first story, which is sort of two stories combined.
00:06:53.625 --> 00:07:04.930
we mentioned Kickstarter in the cold open as the prompt, but we had a story, an interesting story this week involving Kickstarter, and then one involving Apple, but in some ways they're related.
00:07:04.930 --> 00:07:08.031
So do you wanna explain those two stories that you found?
00:07:08.404 --> 00:07:09.105
Yeah, sure.
00:07:09.105 --> 00:07:18.942
So, you know, Kickstarter, recently, made some rule changes about, how it manages, sexually explicit, campaigns, on its site.
00:07:19.372 --> 00:07:34.026
And, it was trying to address a discrepancy between the payment processor Stripe, f- which Kickstarter people use, and their rules about sexually explicit, materials, and Kickstarter's rules, which were a little more liberal.
00:07:34.057 --> 00:07:49.141
They also have regulations, about sexually explicit material, but you know, the devil is in the details, so there was some space there, and sometimes people's Kickstarters were getting frozen by Stripe, and Kickstarter wasn't really able to help them out or unfreeze the funds or that sort of thing.
00:07:49.391 --> 00:07:52.641
So they decided, well, you know, here's our, trust and safety decision.
00:07:52.641 --> 00:07:54.865
Let's, like, close the gap between these two.
00:07:54.865 --> 00:07:57.329
And then, they had to back down from that.
00:07:57.358 --> 00:08:07.184
There was a, cry out from the, Kickstarter users, that this was, not what they wanted and it interfered with their creativity and their, campaigns and that sort of thing.
00:08:07.184 --> 00:08:12.733
And so Kickstarter realized relatively quickly, like,"Oh, okay, this isn't what our people want.
00:08:12.744 --> 00:08:30.177
We need to, like, go back and roll back to our original rules." And then they just have kind of like a makeshift way of trying to manage the problems between what the payment processor Stripe wants and what their rules are and what Kickstarter's own community rules are, and just try to, manage the discrepancy there.
00:08:30.480 --> 00:08:41.715
so you know, here you have a situation where, Stripe is really, influencing or affecting what the preferred rules would otherwise be on platforms for which it just provides payment processing.
00:08:42.123 --> 00:08:54.667
so you know, we can-- we're gonna talk about that, but I think that, the other big story I thought was similar,'cause we're talking about, who gets to control what gets to be done online, and here you have Stripe having this outsized, impact.
00:08:55.047 --> 00:09:27.341
And I think, you know, the other story I wanted to talk about was, about Apple, and ahead of their annual developer conference, they published this overview of the steps that they take in order to protect, users and developers, particularly in the App Store, and this long list of, steps they take and how their moderation and control of the App Store has helped, you know, eliminate, or not eliminate, but decrease fraud, decrease spam, interrupt inauthentic reviews, malware, and those sorts of things, and how this is really beneficial.
00:09:27.341 --> 00:09:41.235
And we know, Apple has this reputation for privacy and security in particular, but Apple has this locked-in ecosystem and, that impacts what people who have iPhones, and use the App Store are able to do online.
00:09:41.556 --> 00:09:53.270
And so here we have two very important, companies, each of which has a outsized impact just based on corporate policies about what users and the public are then able to do
00:09:53.734 --> 00:09:54.083
Yeah.
00:09:54.193 --> 00:10:00.660
I, I thought both of these stories were, were really interesting, and I think it's one of these issues that is less well thought of.
00:10:00.660 --> 00:10:15.456
Like, when people are talking about trust and safety and content moderation decisions, they naturally sort of tend to think specifically about, the big social media companies and, the direct impact of, Facebook deciding what kind of content they're gonna allow, what kind of content they're gonna take down.
00:10:16.015 --> 00:10:26.441
starting with the, the Stripe story, that reveals this sort of hidden layer of infrastructure provider that I think is becoming a bigger and bigger story over the last few years.
00:10:26.744 --> 00:10:42.364
and there, there was actually just a, really good book that came out recently by Rainie Reitman, called Transaction Denied, uh, just came out like a month ago, talking about the payment providers and what kind of impact they have on speech and their ability to, reject speech.
00:10:42.474 --> 00:10:50.962
Often, because they're a layer away from the actual consumer, often in very hidden ways that a lot of users don't even know what's happening.
00:10:51.383 --> 00:11:16.304
and part of what struck me as interesting about the Kickstarter situation was because of the backlash, Kickstarter was actually p- I thought pretty, honest and upfront first saying like,"Yeah, we, we totally fucked this up." but, but then, sort of saying like,"Look, Stripe processes the payments, and they have their rules," and they were, like, killing projects that Kickstarter itself had approved that Stripe said went against their rules.
00:11:16.589 --> 00:11:20.905
and it just, raises a whole bunch of questions about, where is the, power?
00:11:20.946 --> 00:11:49.618
And, I'm sort of curious on your take on this, you know, one of the things that I've been thinking a lot about lately is the fact that the powers that be, for both commercial and political power reasons, have a way of hunting up and down the network stack to figure out where that friction point is to then push on it, in some cases to squeeze out profits and in some cases for political power.
00:11:50.067 --> 00:11:55.474
And I'm sort of curious, how do you view that and th- this sort of hunt for that choke point?
00:11:56.028 --> 00:11:56.139
Yeah.
00:11:56.139 --> 00:12:12.817
I mean, it, it's such a-- it, impacts almost all of the policy conversations we have about the internet, you know, all the way from, like, network neutrality to, copyright you know, infringement interdiction to, questions about what people are allowed to say and do as end users on the platform.
00:12:13.260 --> 00:12:18.359
I think that payment processors have been a underexplored choke point themselves.
00:12:18.649 --> 00:12:36.816
You know, we know, the past there's been concern about how MasterCard and Visa, won't process payments for, sites that are-- have to do with pornography or sex work or, or that sort of thing, and then that becomes kind of themselves having a, a control over, activity online that is potentially lawful.
00:12:37.086 --> 00:12:47.725
and I know, the ACLU filed a complaint with the FTC against MasterCard and Visa for refusing to process payments related to Pornhub or other kinds of sex worker type sites.
00:12:48.051 --> 00:12:50.551
you know, and we have this example with Stripe.
00:12:50.581 --> 00:12:56.552
I think, there are also the efforts to kind of take the regulation down in the stack, like you said.
00:12:56.552 --> 00:13:03.034
And one case I think is really important about that is Sony versus Cox, which was in the Supreme Court just this, little bit ago.
00:13:03.335 --> 00:13:18.846
And Sony, sued, so copyright holders sued an ISP basically saying that Cox needed to, you basically cancel people's accounts when Sony came to it with these takedown demands or with these allegations of copyright infringement.
00:13:19.222 --> 00:13:25.282
and there's a lot of, like, reasons why the case got this far, but it was like a trillion dollar case.
00:13:25.322 --> 00:13:37.511
And the idea is if you can get the ISP to basically block somebody's IP address and not provide them service anymore, yeah, you're doing a great job stopping them from infringing copyright, but you're also stopping them from accessing the internet altogether.
00:13:37.511 --> 00:13:46.562
And not just stopping that person from accessing it, but anybody who uses that IP address, whether it's a household or a library or, you know, a coffee shop or whatever it is.
00:13:46.851 --> 00:13:53.087
So, the regulation when the further down you go, almost it seems like the more, overbroad
00:13:53.505 --> 00:13:53.885
Yeah.
00:13:54.256 --> 00:13:56.476
it's a very blunt instrument at,
00:13:56.548 --> 00:13:58.129
Very blunt instrument.
00:13:58.129 --> 00:14:01.859
Yeah, exactly, and I think that that becomes a real concern.
00:14:02.190 --> 00:14:10.210
you know, instead of looking at an individual's wrongdoing, you look to control it at a centralized point.
00:14:10.515 --> 00:14:16.792
and that centralized point can be very effective but is almost always gonna be overkill
00:14:17.299 --> 00:14:17.669
Yeah.
00:14:18.000 --> 00:14:29.423
And it's interesting to me in a few ways, one of which is that, the founders and, CEO, I don't know if it-- it's two, two brothers founded Stripe, and I don't know if they're like co-CEOs or what, I forget.
00:14:29.832 --> 00:14:40.283
But they have spent many years sort of presenting themselves to the world as, I would say extremely libertarian, free speech supportive.
00:14:40.510 --> 00:14:46.663
you know, they really-- they show up on a lot of these podcasts and discussions about how they're enabling free speech.
00:14:46.943 --> 00:15:05.110
So it struck me as, as somewhat noteworthy then that apparently they're, whether it's for regulatory reasons or for whatever reasons, they're the ones who are the, the sort of prudes, you know, trying to force, force Kickstarter into shutting down certain forms of adult content that, were being funded through them.
00:15:05.580 --> 00:15:15.176
and yet, you know, they sort of stay out of it by, I mean, Kickstarter threw them under the bus, r-rightly so, because it was really their, issue that was happening.
00:15:15.456 --> 00:15:18.155
But it, it strikes me as this thing where...
00:15:18.461 --> 00:15:27.410
Part, part of what I wonder, and I don't know if you know this or not, is like how much of this has to do with the fact that Stripe is in a heavily regulated industry as well?
00:15:27.811 --> 00:15:37.107
Like, once you get into the financial space, they will often come up with excuses about how we have to do like know your customer stuff and because we're all worried about money laundering.
00:15:37.398 --> 00:15:48.962
and there are legitimate concerns there, but I wonder how much of that is used as cover to then be an excuse for saying like,"Okay, no more adult content" or, or anything of that nature.
00:15:49.466 --> 00:15:49.716
Yeah.
00:15:49.716 --> 00:15:52.785
I mean, I think it's, you know, why does this happen?
00:15:52.785 --> 00:16:06.725
And I think any company is going to be impacted by regulation, or fear of regulation and fear of liability, which I think, as you said, is probably much greater in the financial services, than it is in other, areas because it is so highly regulated.
00:16:07.075 --> 00:16:11.932
Money, I mean, the companies, want to make money, and I think that impacts their decision.
00:16:11.932 --> 00:16:24.086
Like Apple had a dispute with"Fortnite," over how much m-money or revenue Apple should make from downloads of the"Fortnite" app, and they had a dispute, and Apple blocked"Fortnite" from the App Store for a while.
00:16:24.383 --> 00:16:26.851
and you can always say, like,"Well, here's why we did it.
00:16:27.022 --> 00:16:30.402
You know, it's, it's not to gain an advantage in litigation.
00:16:30.402 --> 00:16:47.400
It's because they're violating our rules about how you, report your income." You know, in any highly regulated, world or with a lot of rules, you gotta be pretty uncreative if you can't come up with a reason to put a, sanction on somebody.
00:16:47.630 --> 00:16:53.788
Um, and then I think you also have just the kind of the values of the company that are something that, applies as well.
00:16:53.788 --> 00:17:21.553
And so maybe, you know, you can be libertarian but still be really concerned about trafficking, or you can be, you know, And I think, you know, one of the things I've always thought is that a lot of these major companies that we're used to, like, you know, the Apples and the Facebooks and the Googles of the world, started in the United States with lawyers who were trained in the United States with values that were, you know, the values that are inculcated by the legal education you get in the United States, which is like, the Constitution and the Bill of Rights and that sort of thing.
00:17:21.992 --> 00:17:44.262
And as time's gone on and these companies have gotten older and the people have changed and they're global and everything, I think that that sort of underlying ethic is less important now than are the concerns about regulation and public relations and money and, all those other types of, impacts that are, You know, the companies are different.
00:17:44.323 --> 00:17:45.113
They're for-profit.
00:17:45.167 --> 00:17:47.431
they have stockholders that they're responsible to.
00:17:47.431 --> 00:17:57.824
So I think we just don't live in the same world today when it comes to how companies police themselves that we lived in back in, say, like 2015.
00:17:58.000 --> 00:17:58.430
Yeah.
00:17:58.730 --> 00:18:18.979
the other thing that this reminds me of a little bit, and I wonder if this has anything to do with it, is that, it's almost been a decade now since we got FOSTA passed, and we, we saw similar sort of pulling back from, allowing or enabling or assisting with adult content in all sorts of forums where you had, Craigslist shut down parts of its site.
00:18:19.118 --> 00:18:25.616
eBay, you know, suddenly started preventing, the selling of adult-related content in certain categories.
00:18:26.008 --> 00:18:30.050
Famously, Tumblr banned adult content as well.
00:18:30.340 --> 00:18:46.547
And a lot of this was sort of, whether accurate or not, was blamed on FOSTA potentially putting liability on them, even though FOSTA's specifically about sex trafficking, but what counts as facilitating or enabling or assisting in sex trafficking is, was unfortunately broad in the way the law was.
00:18:46.873 --> 00:18:51.776
D- do you think that any of this could be sort of a specific regulatory response to something like that?
00:18:52.215 --> 00:18:53.326
I don't know.
00:18:53.425 --> 00:18:58.036
I do think that there's a general sense of like, why take the chance?
00:18:58.036 --> 00:18:58.945
You know what I mean?
00:18:58.945 --> 00:19:06.989
If a small part of your revenue is based on, this type of content, and you don't need that revenue, but the potential risk is high.
00:19:06.989 --> 00:19:27.122
I mean, this is one of the reasons why we are so concerned about regulation, uh, you know, overall, is because it does tend to have just, basically every time we see that these regulations have a outside effect where it encourages more takedown and over-censorship than what the actual text could be read to, say.
00:19:27.531 --> 00:19:27.988
So it's,.
00:19:28.038 --> 00:19:31.228
You're going to have these situations where too much stuff is caught in the net
00:19:31.778 --> 00:19:32.127
Yeah.
00:19:32.336 --> 00:19:33.522
So I wanna talk a little bit more...
00:19:33.522 --> 00:19:37.615
We've been focusing on the Kickstarter part of it, but I wanna talk a little bit more about the Apple side of the story.
00:19:37.615 --> 00:19:38.556
Apple's a little bit different.
00:19:38.556 --> 00:19:40.546
That's obviously a little bit more consumer-facing.
00:19:40.904 --> 00:19:43.525
and, you know, the Apple announcement is, is really interesting, right?
00:19:43.525 --> 00:19:53.088
I mean, they're sort of talking about all of this stuff that they've blocked, and, and they're sort of very proudly talking about, preventing$2.2 billion worth of fraud and,
00:19:53.244 --> 00:19:53.795
of fraud.
00:19:54.028 --> 00:20:05.517
yeah, and, you know, and dangerous apps and account ki- You know, there's, the sense here in this announcement is basically like Apple's protecting you, Apple's protecting the world, Apple's making the world safe.
00:20:05.740 --> 00:20:08.516
And there is value in that, right?
00:20:08.566 --> 00:20:15.700
I mean, imagine the headlines if there was 2.2 billion more worth of fraud and it was happening on, on iPhones or whatever.
00:20:16.162 --> 00:20:23.864
but, like, I'm sort of balancing that with the fact that then we're also sort of trusting this one company to sort of police these things and, protect us.
00:20:24.023 --> 00:20:31.270
So I'm sort of curious, like, where do you come down on, like, they're protecting us versus there's sort of a police state element to it?
00:20:31.846 --> 00:20:32.885
Yeah, absolutely.
00:20:32.885 --> 00:20:39.346
I mean, there's a thing with Apple is there's this, you know, it's extremely popular platform, but there's a centralized point of failure.
00:20:39.603 --> 00:20:52.269
and so you have this like choke point, again, where it's very effective to target the company for censorship or the company's own censorship decisions impact, all these users.
00:20:52.269 --> 00:21:11.876
So, we had recently a case where there are people develop these apps in order to keep track of ICE agents or to monitor ICE agents' activity on the streets of Minneapolis and other places during the ongoing crackdown, on people who, they suspect of being, here without proper authorization.
00:21:12.217 --> 00:21:23.490
And, Apple, basically took down a number of these ICE watch-type applications, and then a day later, Google took these apps o-out of Google Play Store as well.
00:21:23.779 --> 00:21:24.960
So you have this point of failure.
00:21:24.960 --> 00:21:32.180
The government comes to them, they give them some co- you know, to say like, you know,"We're expecting you to do this," and then they do.
00:21:32.594 --> 00:21:37.061
and since Apple is a global store, they h- do this in other countries as well.
00:21:37.061 --> 00:21:52.142
Like there's an example where, Apple's made a lot of accommodations to operate in China and the Chinese government, had Apple remove gay dating apps from the App Store based on their own, ideas about what is or is not appropriate.
00:21:52.491 --> 00:22:01.124
So, when you have a central point of failure like that, you have a, right there that, you know, this is where a coercive government or whatever is gonna focus their attention.
00:22:01.513 --> 00:22:04.194
So, I think in some ways it can be a trade-off.
00:22:04.493 --> 00:22:15.035
I hear my colleagues at the ACLU telling me that security doesn't require a closed ecosystem that is impenetrable, and I believe that.
00:22:15.088 --> 00:22:25.098
but I also think that the way Apple has set things up and the way they do end-to-end encryption in their iCloud backups and that sort of thing, that they provide a lot more security than other platforms do for people.
00:22:25.516 --> 00:22:29.268
it's not the only way, but here the way they've set it up, there is this trade-off.
00:22:29.268 --> 00:22:30.948
It makes Apple extremely powerful.
00:22:31.347 --> 00:22:34.121
And same thing with, Cloudflare, right?
00:22:34.121 --> 00:22:35.851
Where you have a single point of failure.
00:22:35.851 --> 00:22:39.404
There's something that, and, these companies are under pressure.
00:22:39.404 --> 00:22:56.125
They have the values of their founders or the, you know, and that I think is a really scary world to live in where you have these weaknesses in the infrastructure of the most important technology for communications and business activity of our time.
00:22:56.638 --> 00:22:56.969
Yeah.
00:22:57.259 --> 00:23:13.297
I mean, one of the lines that we will repeat over and over again on this podcast is, what believe Charlotte Wilner came up with, which was that, trust and safety could also stand for trade-offs and sadness because it's, it's all trade-offs and sadness.
00:23:13.297 --> 00:23:15.176
There's no, there's no right answer.
00:23:15.416 --> 00:23:32.642
Each approach, you know, there are incentives and reasons why things happen these ways, and when you have large centralized choke points, That's very helpful for, certain aspects of security, but also they become targets and, and there then are questions about who has control over those choke points.
00:23:32.642 --> 00:23:41.788
And so I think these two stories both are, are really good at, at highlighting that issue and how, uh, you know, I don't think either of us are saying that one approach is the right approach.
00:23:41.788 --> 00:23:49.717
It's just sort of making clear what is often not as well thought about, which is that there are always these choke points, and they're not always the most obvious ones.
00:23:50.164 --> 00:23:50.605
Yeah.
00:23:50.884 --> 00:23:54.029
I mean, I think the answer there,'cause you're right, there's trade-offs.
00:23:54.029 --> 00:24:09.063
But I think the answer there is for when the trade-off is made, the decision has been made, Apple's gonna have this closed ecosystem, we try to minimize the downside, by bringing a strong public advocacy against Apple when it makes censorship decisions.
00:24:09.093 --> 00:24:24.834
So, you know, sort of name, shame, blame, pressure, complain, you know, and, and h- so that when this happens again the next time, Apple thinks, there is some cost to us making this, this censorship decision.
00:24:25.045 --> 00:24:30.781
and we try to bring that through, you know, whether it's FTC complaints or, public advocacy.
00:24:31.066 --> 00:24:39.108
I think that we don't have to accept all of the downsides of the trade-off as citizens.
00:24:39.492 --> 00:24:44.750
Yeah, I mean, I think part of the discussion of the trade-off is how do you m- you know, minimize the downsides.
00:24:44.780 --> 00:24:47.411
That doesn't get rid of the trade-off, but allows you to, you know...
00:24:47.570 --> 00:24:53.057
But that also involves some level of transparency and, openness and discussion about what those actual trade-offs are.
00:24:54.096 --> 00:24:56.144
Right
00:24:56.249 --> 00:24:56.989
story.
00:24:57.078 --> 00:25:08.209
you know, one of the things we've been following over the last few years obviously is the Online Safety Act in the UK and Ofcom, and they've been, beginning to do some enforcement actions there.
00:25:08.568 --> 00:25:13.798
And, There were a few announcements this week, including one with, X, but I'm gonna leave that one aside.
00:25:14.238 --> 00:25:25.268
But there was another one against a, an even more controversial site, if you can believe that, than X, which is the site that is known as Sanctioned Suicide, sometimes referred to as SASU.
00:25:25.869 --> 00:25:29.354
obviously this is, uh, a very, very sensitive issue.
00:25:29.354 --> 00:25:39.537
Obviously, whenever you're talking about anything having to do with suicide, it is a tricky issue to talk about for a variety of reasons, and Sanctioned Suicide is a site that has been around.
00:25:39.537 --> 00:25:40.757
It's very controversial.
00:25:40.797 --> 00:25:42.926
It has been banned in a number of countries.
00:25:43.297 --> 00:25:50.646
There have been attempts within various states in the US to see if they can ban it, though the First Amendment basically should not allow that.
00:25:50.797 --> 00:25:54.093
Well, there may be some, some court cases that test that at some point.
00:25:54.411 --> 00:26:06.192
and so it, it's an extremely controversial site, and Ofcom effectively went after them and this week issued a£950,000 fine against Sanctioned Suicide.
00:26:06.615 --> 00:26:27.281
and the, thing that struck me as very interesting is one of their lawyers, Preston Byrne, who's been very vocal on this subject and specifically on pushing back against Ofcom enforcement, that he feels or his clients feel or, know, reaches into the US where they should be protected and, and they're not subject to UK laws.
00:26:27.647 --> 00:26:39.150
he wrote a very long and detailed post sort of pushing back on Ofcom's fine, and in fact noting that part of the explanation of their fine was that they had to use a VPN.
00:26:39.596 --> 00:26:43.469
And so I'm not gonna go into the full background of the story'cause it is very long.
00:26:43.469 --> 00:26:44.778
We'll have a link in the show notes.
00:26:45.138 --> 00:26:59.396
But effectively, there was conversations between Ofcom and Sanctioned Suicide last year, and Sanctioned Suicide appeared to take it seriously and put in place a geo-block to effectively try and block people from the UK from reaching the site.
00:26:59.886 --> 00:27:15.359
There was some sort of h- you could kind of get around it through a system where if you had already created an account before they put in place the geo-block and you used a VPN, you could reach some aspect of the site.
00:27:15.390 --> 00:27:21.647
There was something a little bit confusing with a sort of anti- spam provider that they use, that you could still access that.
00:27:21.968 --> 00:27:48.517
But the end result was that it was very difficult to reach the site if you were in the UK, and they had put in place, tools and blocks, and Ofcom had originally indicated that this was an acceptable approach, but then changed their mind and issued this fine, and somewhat amusingly, to me at least, you know, sort of revealed within the, the details of the fine that they issued that they had to use a VPN to, reach the site.
00:27:48.946 --> 00:27:56.272
Even though they claimed that the VPN was not effective, they still had to use it in order to reach the site and to describe what, what kinds of content they found.
00:27:56.673 --> 00:28:09.400
And, Preston Byrne sort of describes in his post that like,"Look, we did geo-block it, and you said it was okay," and you're sort of using these tricks that, yes, eventually anyone can get around them, but you have to be sort of technically savvy.
00:28:09.839 --> 00:28:18.965
And really, what the notice from Ofcom proves is that the geo-blocking was somewhat effective because they had to use the, use a VPN to get around it just to issue the fine.
00:28:19.520 --> 00:28:23.912
So, Jennifer, I'm, I'm sort of curious, what did you think of this story and everything that was happening here?
00:28:24.439 --> 00:28:35.142
Well, you know, I think, I think as a lawyer, I immediately sort of thought about how you are engineering your, jurisdiction over the site, because here they are basically saying,"We opt out.
00:28:35.142 --> 00:28:36.372
We don't wanna do business.
00:28:36.372 --> 00:28:45.362
We're not doing business in your country." And it's like, but the internet is global, and it's possible some way or another, it routes around censorship, right?
00:28:45.362 --> 00:28:50.319
It's possible some way or another to get in touch with the site from, the UK.
00:28:50.609 --> 00:29:08.101
And it's just interesting to me, just sort of, basically what that means is that any website is subject to the jurisdiction, theoretically, of every country on the face of the planet, even if you try to stop that from happening and, you know, target countries specifically where what you're doing is lawful.
00:29:08.439 --> 00:29:13.419
and it is, you know, a problem similar to centralization.
00:29:13.419 --> 00:29:27.303
This globalization of companies is a problem because, every country that comes in with whatever their rules are, eventually you kind of devolve to, like, the lowest, common denominator of just only what's legal everywhere.
00:29:27.688 --> 00:29:40.842
and then the special protections or values or whatever that different countries might have are, kind of ineffectual if you have to obey, anyone who can get in touch with your site with a VPN, which is basically everyone.
00:29:41.304 --> 00:29:57.785
it feels like-- or not feels like, I mean, I think legally it's true, but also I think it's important that websites that have lawful content be able to operate in the world, at least for the people who, live in the countries for which it's lawful.
00:29:58.045 --> 00:30:05.669
I still don't love that because I think it's fragmented, you have your, like, balkanized personal, country internet, which isn't really a great thing.
00:30:05.669 --> 00:30:11.088
It's supposed to be a global network where we can all communicate with each other and get information.
00:30:11.431 --> 00:30:18.134
but at the very least, sites should be able to operate in their particular jurisdiction without kind of a,"I got you," you know?
00:30:18.753 --> 00:30:21.903
"Ha ha," you know, with by accessing it with a VPN.
00:30:22.576 --> 00:30:30.537
another concern I have is just, like, to more effectively block users from certain countries, I think is a bit of a surveillance nightmare.
00:30:30.753 --> 00:30:39.910
and we've seen this in other contexts, like with, gambling apps or whatever, to try to figure out and make sure that the users are in a jurisdiction where online gambling is permitted.
00:30:39.910 --> 00:30:44.119
There's a lot of location tracking, um, providing your identification.
00:30:44.119 --> 00:30:58.808
So it's just, techniques that really interfere with people's privacy, people's anonymity, and, can put the users or visitors, posters to a site in some jeopardy because this identifying information about them is being collected.
00:30:58.808 --> 00:31:13.398
And I think that there's this real push, tracking IP addresses or more, in order to make these geo bans more effective, and that it's a real worry for me as a surveillance lawyer that that's also, like, a side effect that we're heading down the road towards.
00:31:13.753 --> 00:31:15.223
Yeah, I, I think it's a real issue.
00:31:15.223 --> 00:31:22.950
I mean, it, it's funny to me, I've talked about this before, but, Techdirt started in 1997, so we're 29 years in, which is insane.
00:31:23.259 --> 00:31:23.609
But
00:31:24.560 --> 00:31:26.710
You should be very proud.
00:31:26.929 --> 00:31:29.679
Wait till we get to 30, okay?
00:31:29.989 --> 00:31:42.025
But, but, but one of the things that, that was, like, a common theme in our very first year was specifically this issue of, jurisdiction, that, pre-internet, jurisdiction was much easier.
00:31:42.025 --> 00:31:47.984
I wouldn't say it was easy, but it was much easier to determine because it was where you were, where the thing happened.
00:31:48.325 --> 00:31:58.775
And as soon as the internet came about and suddenly just, you know, wiped out borders in terms of what was available where, the jurisdiction questions were, like, one of the biggest things.
00:31:58.954 --> 00:32:02.545
And we're now 29 years later, and we still haven't figured that out.
00:32:02.615 --> 00:32:11.766
And we're still sort of sorting through what does all that mean, and we still don't seem to have really good answers for, like, how do you handle global internet with different local laws?
00:32:12.145 --> 00:32:27.526
And, it's fascinating to me that this issue so many years later, like, there are attempts, and as you said, like, some of the, fallout is that we have a really fractured internet in a lot of ways, which I, I don't think is a good thing, or that we have a lot of surveillance, which also I don't think is a good thing.
00:32:27.996 --> 00:32:35.398
But it still feels like we're still struggling with this question of, you know, how do you actually handle legal jurisdiction on a global internet?
00:32:35.638 --> 00:32:36.916
And, Yeah, it's weird.
00:32:37.618 --> 00:32:38.578
It is weird.
00:32:38.608 --> 00:32:45.527
I mean, you know, my first year of law school, you do civil procedure and you go over jurisdiction, and it's like a big yawn.
00:32:45.896 --> 00:32:49.696
Um, I think I can say probably most people felt that way.
00:32:50.037 --> 00:33:03.240
And then some of the earliest cases I did, you know, I did one case which was about a website that was a CNN spoof website, and the client, just basically lived in Massachusetts or something like that.
00:33:03.510 --> 00:33:18.317
Um, and CNN is, was headquartered in Georgia, and they sued him in Georgia, and he didn't have anything in Georgia, but the court was like: Well, you targeted CNN, and CNN is in Ge- you know, how can it be in something?
00:33:18.317 --> 00:33:23.448
But CNN is in Georgia, so we had this big jurisdictional battle, and they're like: No, you can be sued here.
00:33:23.712 --> 00:33:56.310
or like in the Lori Drew MySpace case, you have somebody who is, doing something that's not illegal, under state law, but they can be, brought into federal court in a different place because, the conduct happened over MySpace, and MySpace is located in a totally different jurisdiction, which allows, you know, the thing there I think is it allows, prosecutors to kind of pick and choose a little bit, so you have the most, aggressive prosecutors can kind of pick cases, you know, from, things that people do around the country.
00:33:56.570 --> 00:34:06.440
And now you have that with countries, like around the world, where you can have the most aggressive regulator can kind of pluck somebody out and be like: Yes, you guys are the ones that we're gonna go after.
00:34:06.852 --> 00:34:14.057
and you know, I mean, I, I think y- I have to recognize as a lawyer, like nowadays, I don't think the law is the most important thing that decides that.
00:34:14.097 --> 00:34:15.378
I think it's the assets.
00:34:15.777 --> 00:34:16.088
You know?
00:34:16.088 --> 00:34:22.998
And it's like if you have people or you have property in the country, then you're subject to their jurisdiction.
00:34:22.998 --> 00:34:27.047
And I often, you know, had had people come to me and be like: What's the rules here about this?
00:34:27.047 --> 00:34:28.617
I'm like: Well, do you have people on the ground there?
00:34:28.617 --> 00:34:29.047
They're like: Yeah.
00:34:29.047 --> 00:34:31.568
I'm like: Do you wanna let those people go to prison?
00:34:31.757 --> 00:34:34.117
"No." Okay, well then they have jurisdiction over you.
00:34:34.458 --> 00:34:39.561
So, so, you know, if you're gonna do business someplace, gonna h- have that trouble.
00:34:39.730 --> 00:34:54.458
I was gonna say that's also why certain countries are now putting in place what I refer to as hostage laws, which is requiring if you wanna operate in this country, you have to have an employee on the ground, which, you know, their only real role is to be threatened to be put in jail if
00:34:54.514 --> 00:34:55.293
know.
00:34:55.528 --> 00:34:57.639
uh, which is sort of horrifying in some ways.
00:34:57.639 --> 00:34:58.590
But it, it, kinda
00:34:58.699 --> 00:35:01.230
I would love to see the job posting for that.
00:35:01.280 --> 00:35:04.369
And then also, like, what's the interview like?
00:35:04.369 --> 00:35:04.929
You know?
00:35:05.340 --> 00:35:06.989
Do you, do you like gruel?
00:35:07.019 --> 00:35:10.170
How many days can you survive on gruel?
00:35:11.211 --> 00:35:11.592
Yeah.
00:35:11.992 --> 00:35:12.722
Oh my God.
00:35:13.492 --> 00:35:15.608
Um, I mean, I'm sure they have some sort...
00:35:15.610 --> 00:35:18.079
it's like when you work in the CIA, you have a cover story.
00:35:18.219 --> 00:35:23.630
I assume that there's some sort of job description which is not technically just be here to go to prison.
00:35:25.628 --> 00:35:26.898
But I, I don't know.
00:35:27.139 --> 00:35:27.588
I don't know.
00:35:27.809 --> 00:35:36.460
I mean, what, like, given that, Sanction Suicide put in place this geo-block, and it appears they went to sort of pretty great lengths to actually try and make the geo-block effective.
00:35:36.706 --> 00:35:44.849
what else would you think that a site like that should do to say like,"Look, we're not targeting your jurisdiction at all." Like, is there anything else that they can do?
00:35:45.422 --> 00:35:59.516
I mean, you know, I mentioned some of the more intensive surveillance things that you could do, you know, in terms of requiring users to prove location basically before they're a-accessing the site.
00:35:59.916 --> 00:36:05.728
Um, and I think that that can be some pretty, risky and dangerous information collection.
00:36:05.829 --> 00:36:23.438
But I don't know that, I'm sure like technically, and I'm sure that there are tons of, cryptographers who are working on ways where you can have like an attestation like this person is not in this country, and have that be something you can rely on without collecting all this other information.
00:36:23.438 --> 00:36:35.150
And I hope that tools like that will be developed so that if we need to have these things, we can have these things without it also being, and this user is Jennifer Granick, and she is, you know, all that other stuff.
00:36:35.405 --> 00:36:35.706
Yeah.
00:36:36.456 --> 00:36:41.556
All right, well, let us move on to our more lightning round set of stories.
00:36:41.556 --> 00:36:44.440
Uh, and this one, there's a nice sort of, segue.
00:36:44.943 --> 00:37:01.432
this is a story from Rest of World, talking about how various African countries are trying to figure out their AI policy, and one of the things that, multiple countries are recognizing is how reliant they are on US-based companies and US-based infrastructure.
00:37:01.753 --> 00:37:14.242
And suddenly these legal questions of, well, how does the law here apply to companies based there, are having a really big impact in, in terms of how these countries are thinking about their AI policy.
00:37:14.242 --> 00:37:20.951
And one of the things that many of these countries in this article, they, they cover Nigeria, Egypt, Kenya, South Africa.
00:37:21.121 --> 00:37:37.364
Though the aside on South Africa is that their AI policy had to be withdrawn last month when people discovered, a researcher actually discovered that the citations in the policy on how to deal with AI appear to have been hallucinated by AI.
00:37:38.563 --> 00:37:39.784
That will be revisited
00:37:39.833 --> 00:37:41.222
can't make this stuff up.
00:37:41.782 --> 00:37:44.092
That's gotta, that's gotta go in your novel.
00:37:44.344 --> 00:37:46.753
Yeah, yeah, something like that.
00:37:46.753 --> 00:37:47.563
Definitely should.
00:37:48.072 --> 00:37:48.893
Make a note.
00:37:49.143 --> 00:37:49.764
yeah.
00:37:50.400 --> 00:38:07.936
but you know, what's, what's interesting is, these countries are suddenly sort of trying to figure out how to deal with that, and one of the things that many of them are pushing for within these policies, you know, whether or not it's realized is still to be determined, is that there needs to be more local sovereignty, data sovereignty.
00:38:07.936 --> 00:38:20.706
Data should stay within these countries, and they, even if they're doing agreements with American companies, that there needs to be some level of control over the data and keeping it local within the countries, which then raises a whole bunch of other issues.
00:38:20.706 --> 00:38:28.367
And we've had this in, in other data localization context where if the data is local, that also means it may be accessible.
00:38:28.396 --> 00:38:39.297
So if a government wants to do surveillance on you, a requirement to keep it local you can say is to protect privacy, but it also may give access to the police or whoever else.
00:38:39.597 --> 00:38:47.567
So I'm sort of curious, what was your take on, on this particular story about the African countries and trying to figure out how to deal with American AI infrastructure?
00:38:48.172 --> 00:38:48.302
Yeah.
00:38:48.302 --> 00:39:08.916
I mean, you know, sovereignty sounds great, and I do think that it makes sense that countries want to be able to, have technology accord with their own laws and values and that they don't necessarily want a big for-profit American corporations deciding what's good and what's bad for people.
00:39:09.206 --> 00:39:10.755
And I agree with that.
00:39:10.786 --> 00:39:25.905
You know, I think that, when you have the rules and the, constraints about what a product like AI can do that are decided by for-profit companies, it's gonna be a certain thing, and there are gonna be other values that go by the wayside.
00:39:25.934 --> 00:39:34.521
Like this whole discussion of AI safety as being like the primary motivation or, you know, the primary like, value added by a company.
00:39:34.521 --> 00:39:39.420
It's when you have such a highly competitive industry, nobody's gonna slow down for safety.
00:39:39.420 --> 00:39:43.096
It's just obviously, it was never true.
00:39:43.275 --> 00:39:46.106
Obviously never true from the, from the beginning.
00:39:46.565 --> 00:39:51.909
Um, and I think that it makes perfect sense that countries would want to, do something, different.
00:39:51.909 --> 00:39:59.043
And I think this is important because for me, one of the issues here is like, AI isn't just information or something somebody says.
00:39:59.043 --> 00:40:07.677
AI is, is something that it does things, and that functionality I think can often and often should be regulated.
00:40:07.677 --> 00:40:09.768
So that makes a lot of sense to me.
00:40:10.217 --> 00:40:26.277
but you know, we, as we talked about before with, the balkanization of the internet and with how, you get the lowest common denominator, of regulation when any country is the decider about what, a tool can be used for, what people can say or do with it.
00:40:26.574 --> 00:40:34.628
this is the issue I think we're gonna have here, with the idea that, you know, we have sovereignty over a particular, tool.
00:40:34.838 --> 00:40:39.599
it is another one of these, trade-offs, yeah, just another one of these trade-offs
00:40:40.193 --> 00:40:41.153
No, it, it's tricky.
00:40:41.153 --> 00:40:57.726
I also think, I mean, there's another trade-off within what you were talking about, which, uh, is trickier than I think most people recognize, which is you talked about the difference between sort of speech and conduct, which is sort of usually the dividing line between, you know, speech is more protected, against regulation, versus conduct.
00:40:58.139 --> 00:41:11.079
But it's not as clear where that border is, especially with, tools like software and AI, the switch from what is speech to what is actually conduct, it would be nice if there was a clear dividing line.
00:41:11.909 --> 00:41:13.900
I'm just not convinced there really is.
00:41:14.398 --> 00:41:15.748
No, there isn't.
00:41:15.748 --> 00:41:24.347
It keeps the, it keeps the speech lawyers occupied litigating what is that, what is that line.
00:41:24.735 --> 00:41:30.733
and you know, I mean, we're dealing with that you know, I mean, I don't wanna take us down a different but favorite road.
00:41:30.733 --> 00:41:38.844
We deal with that in the context of, Section 230 between what is, the activity on a platform and what is speech on the platform.
00:41:38.875 --> 00:41:50.393
What is when the platform, chooses what information or prioritizes particular information for us to see, is that like, functionality of the platform or is that the platform's speech?
00:41:50.393 --> 00:41:51.684
Is it the third party's speech?
00:41:51.684 --> 00:42:07.242
And we filed when I was at the ACLU, we filed a brief about this in the, Gonzalez versus, Google case discussing, what is speech in terms of how the, platform operates to prioritize particular content.
00:42:07.523 --> 00:42:29.923
But we tried to distinguish that in the brief from things that the, company does to prioritize content when what it's doing is only showing, men the most lucrative jobs or only showing white people these set of houses or, you know, sort of a, online but still discrimination that would be illegal offline.
00:42:30.193 --> 00:42:45.356
And so how do you think about, the difference between here's what you, Jennifer, might like to see and here's what you white people deserve to have in your education and housing and credit, portfolio?
00:42:45.902 --> 00:42:51.356
Yeah, I, we don't have time to go deep into this, but yes, it is like all, with all of these things, right?
00:42:51.356 --> 00:42:52.297
It is a really...
00:42:52.547 --> 00:43:11.648
You know, there are things that are clearly problematic and where there are laws against them, but you have to be very careful wading into the areas where, you know, it's easy to say,"Well, this is conduct, this is speech," but the lines are very, very blurry, and that, that's where, uh, there's a lot of litigation and keeps lawyers like you plenty busy.
00:43:12.291 --> 00:43:13.211
Yeah, totally.
00:43:13.211 --> 00:43:17.382
And I can understand why different countries wanna have that, you know, idea too.
00:43:17.382 --> 00:43:25.362
Like, we want tools to operate in the benefit of our citizens, and so here's how we want it to be.
00:43:25.362 --> 00:43:37.349
Of course, as I'm saying it, it's like the most optimistic view of sovereignty because we also know that not all governments are like,"Well, let's-- what's good for our citizens?" A lot of governments are like,"What's good for me?
00:43:37.380 --> 00:43:52.889
Can I use this deepfakes takedown law in order to get bad stuff about me, the president, taken offline?" And so, you know, not-- we can't trust that everyone is really c- every government is really concerned about free speech and their citizens.
00:43:52.980 --> 00:43:54.579
I don't know why that was the example
00:43:54.634 --> 00:43:59.364
was going to say that was a fantastic segue to our next story.
00:43:59.664 --> 00:44:04.010
So d- which is that, yes, the Take It Down Act is now in effect.
00:44:04.010 --> 00:44:05.141
Do you wanna talk about that?
00:44:05.585 --> 00:44:05.715
Sure.
00:44:05.715 --> 00:44:11.956
I mean, this is a law that was signed about a year ago and is now fully in effect.
00:44:11.956 --> 00:44:20.188
The Take It Down Act was, intended to address the, um, problem with non-consensual intimate imagery or NCII.
00:44:20.623 --> 00:44:29.505
and, this includes, not just, images of real people, but also, what we call deepfakes or AI-generated, images.
00:44:29.545 --> 00:44:34.755
I think deepfakes suggests we can't tell the difference between them and real, but they're really just fakes.
00:44:34.784 --> 00:44:39.144
So I don't know how deep it is or whatever, but it's called deepfakes.
00:44:39.465 --> 00:44:53.228
And the law sets up a notice and takedown, process where if a platform gets notification that there is some NCII on it, then there's a 48-hour turnaround to take the, uh, information offline.
00:44:53.579 --> 00:45:05.208
And we know from, in other notice and takedown regimes like the Digital Millennium Copyright Act, that these regimes tend to create a, over-incentive to take things down even if they're lawful.
00:45:05.518 --> 00:45:06.628
The company doesn't know.
00:45:06.628 --> 00:45:09.358
It doesn't have time to, ask questions or...
00:45:09.635 --> 00:45:18.436
and so these, regimes can be weaponized to take down information that maybe has nothing to do with NCII.
00:45:18.815 --> 00:45:31.514
and so not only do you have a problem that maybe the law is overbroad as to what should be taken down, that's a problem, but also that in practice, the takedowns will be broader even than that interpretation of the law.
00:45:31.768 --> 00:45:42.903
and just recently, the chair of the FTC, wrote to a bunch of the large platforms, large and medium platforms, saying,"You know, we're gonna start enforcing this, so you guys better be doing it.
00:45:43.114 --> 00:45:55.782
There are huge fines at stake." but there's, like, explicit statements by President Trump that he plans to use this law to try to get, critiques, and negative information about himself, taken offline.
00:45:56.072 --> 00:46:02.733
and that's just so interesting because I think there's just a very, very limited amount of NCII about President Trump.
00:46:02.733 --> 00:46:03.663
I mean, I don't know.
00:46:03.663 --> 00:46:05.572
Maybe I just run in the wrong circles.
00:46:05.612 --> 00:46:07.092
Um, so it seems like,
00:46:07.710 --> 00:46:22.494
the, the, the example, and we, we had an article on Techdirt about this last year, was that, South Park in its last season often had, images of a, AI-generated video of a naked Donald Trump.
00:46:22.755 --> 00:46:26.702
and so the question was, would that violate the Take It Down Act?
00:46:26.952 --> 00:46:43.106
When it's broadcast on TV, it's protected, but when it's on the internet, and their videos have been posted on the internet, does that suddenly trigger an issue that Donald Trump could use the Take It Down Act to demand that YouTube take down, say, South Park videos?
00:46:43.652 --> 00:46:45.552
So A, God bless South Park.
00:46:45.911 --> 00:46:50.672
B, obviously I underestimated the market for Trump NCII.
00:46:50.672 --> 00:47:06.829
And then, you know, C, I think this is something, you know, at the ACLU we really worried about when the bill was, introduced, which is there are really not safeguards for political satire or critique or, you know, that sort of protected speech.
00:47:06.829 --> 00:47:25.606
And there's no thing here like you have to necessarily, like, believe it is a video of a real person, and so that, leaves open to this concern, that political critique can be, targeted under this law, and failure to take it down can result in real liability.
00:47:26.034 --> 00:47:30.034
the related thing, I mean, you mentioned the FTC has been very vocal in talking about this.
00:47:30.382 --> 00:47:49.710
it should be noted that the chair of the FTC, Andrew Ferguson, has been pretty open about choosing his targets based on partisanship, and he has opened a bunch of investigations that were clearly done to, suppress speech and create chilling effects from those who are critical of Donald Trump.
00:47:49.739 --> 00:48:05.594
There was a whole investigation into media matters, and more recently there was the invest- not investigation, but there were, civil investigative demands, which are subpoenas into NewsGuard, which was a company which was run by a, a, a fairly conservative guy.
00:48:05.994 --> 00:48:21.246
But, Newsmax became very upset because they were ranked low for trustworthiness in NewsGuard, and so suddenly the FTC started investigating NewsGuard, and it was clearly just a partisan free speech suppression kind of situation.
00:48:21.496 --> 00:48:40.141
So the fact that the FTC gets to enforce this law, I think it's going to be really worth watching who it is they go after and what reasons, because lots of people would argue that, what Grok was doing on X with its AI image generation, could have violated some aspects of the Take It Down law.
00:48:40.561 --> 00:48:50.222
and so would a Trump FTC go after X for violating this law when Elon Musk and Donald Trump are on good terms?
00:48:50.621 --> 00:48:52.972
And that's gonna be something worth watching.
00:48:53.411 --> 00:49:07.150
I think, you know, theoretically we kind of pose or I kind of posed the question of do you want this for-profit corporation to regulate or do you want this government, with their own sort of censorship and politics and whatever to, to govern?
00:49:07.501 --> 00:49:23.025
And I think that that kind of philosophical, debate has to actually take place in the context of what are we really seeing, which is, here in the United States, we have a government that has been weaponized against ideological and political opposition.
00:49:23.474 --> 00:49:45.307
And, it's kind of great having been a First Amendment lawyer for so long that we can ni- finally say to people,"See, this is what we told you that you have to be worried about, and this is why we pushed for all those rules that you didn't like because, you know, you thought the government was gonna be a good actor." And in theory, sure, that's nice.
00:49:45.307 --> 00:49:46.208
They're helping the public.
00:49:46.577 --> 00:49:50.217
But in practicality, this is what happened, and we turned on a dime.
00:49:50.387 --> 00:49:52.777
You know, historically, our government's turned on a dime.
00:49:53.117 --> 00:49:59.088
And so I think absolutely right when you think about these things, you can't really think about it anymore in the abstract.
00:49:59.088 --> 00:50:01.757
You have to think about it as like, look, this is playing out.
00:50:01.788 --> 00:50:08.677
Our worst fears, our worst nightmares are playing out in reality here in the United States of America.
00:50:08.677 --> 00:50:11.338
And so, you know, this is what we're seeing.
00:50:11.338 --> 00:50:17.085
And so having empowered the government to make these decisions we're reaping what we've sown.
00:50:17.376 --> 00:50:17.706
Yeah.
00:50:17.945 --> 00:50:18.155
Yeah.
00:50:18.186 --> 00:50:19.835
So that's definitely one that we'll be following.
00:50:20.365 --> 00:50:24.405
Our final story, we are running low on time, so we'll make this one quick.
00:50:24.782 --> 00:50:32.565
we-- for the most part, I mean, I mentioned here and there, we have avoided talking about X and Elon Musk this week, except for this last story, which again will be really quick.
00:50:32.795 --> 00:50:43.034
But X has changed its policies that, you know, Elon Musk took over the site and promised to bring free speech back, and it was going to be the, free speech platform, the center of the world for speech and all this stuff.
00:50:43.463 --> 00:50:49.177
And apparently, they have now put in place rules that, if you really wanna speak, you kinda have to pay.
00:50:50.067 --> 00:50:55.327
So there are limits on how much you can now tweet before you have to pay.
00:50:55.327 --> 00:51:03.711
So you can do 50 posts a day or 200 replies a day, and if you d- haven't paid and you don't have a blue check mark, you can not go above that.
00:51:04.282 --> 00:51:09.443
Now, some people will argue, and you might argue, that 50 posts is, that's a, it's a lot of posts.
00:51:09.552 --> 00:51:11.833
200 replies is, is a lot of replies.
00:51:11.862 --> 00:51:15.402
That should work for most people, and probably does work for most people.
00:51:15.402 --> 00:51:32.266
But I could definitely see, you know, people who are commenting on sports or news or whatever, if there's like a breaking story, I could see people easily surpassing that and then being pushed to, have to pay for it, which is a very different social media experience than I think most people have these days.
00:51:32.592 --> 00:51:35.143
and so I sort of wonder what impact that's gonna have.
00:51:35.213 --> 00:51:36.632
What, what was your take on this story?
00:51:37.105 --> 00:51:47.978
I think it's kind of an arbitrary line l- drawn to try to, you know, make a distinction between, regular users and commercial users maybe, and sort of like this is how we can make money.
00:51:48.380 --> 00:52:08.213
to me, it made me think about virality and kind of the benefits and dangers of virality for messages more generally and how, you know, other companies have tried to limit, especially when you don't know what the message is, try to limit virality so that, like, you don't have a message or a group that's basically fomenting mob violence or something like that.
00:52:08.554 --> 00:52:23.324
I think in either way, the company is just kinda trying to draw a line between, like, what is something people really should know and is a big enough group to have that important message get out versus something that's probably mob violence.
00:52:23.364 --> 00:52:23.923
You know?
00:52:24.204 --> 00:52:33.155
What is something that's, like, what a regular user's level of interactions on X is versus something that's spam or a commercial account that's taking advantage.
00:52:33.365 --> 00:52:36.356
And so it's just an example of how do we draw lines?
00:52:36.612 --> 00:52:44.001
Yeah, and it, it is fairly arbitrary and there's, you know, it's not entirely clear are they doing this just to try and get more people to sign up and pay?
00:52:44.001 --> 00:52:49.641
Is it a revenue generation play or is it a anti-spam tool or is it a combination of both?
00:52:49.641 --> 00:52:54.840
And then did they do any testing, investigations into whether or not this was the right levels?
00:52:55.170 --> 00:52:56.780
There are all of these choices that are made.
00:52:56.780 --> 00:53:04.831
I don't have much faith that there was much thought put into this just because I don't think X does things with particularly a great deal of thought.
00:53:05.108 --> 00:53:11.831
and it'll be interesting to see, if we start to see people bumping up against these limits and how they feel about it, as time goes on.
00:53:11.831 --> 00:53:21.485
But it's, it's interesting to see'cause we sort of consider social media generally historically to be this kind of thing that you can, do as much as you want, you know, for better or for worse.
00:53:22.434 --> 00:53:24.014
But, but now there are limits in place.
00:53:24.815 --> 00:53:30.315
Anyways, we are basically out of time, but Jennifer, thank you so much for jumping into the guest hosting seat.
00:53:30.364 --> 00:53:32.644
This was really fun, really interesting discussion.
00:53:32.715 --> 00:53:34.695
I hope that listeners really enjoyed it.
00:53:35.262 --> 00:53:35.902
I certainly
00:53:36.237 --> 00:53:36.657
I did.
00:53:36.657 --> 00:53:36.916
too.
00:53:36.976 --> 00:53:39.097
And, thank you everyone for listening as well.
00:53:39.788 --> 00:53:45.275
And, we'll be back next week and Ben will be back from his paternity leave, and we'll have lots of exciting news then.
00:53:45.306 --> 00:53:46.255
So thanks again.
00:53:46.498 --> 00:53:47.108
Thanks, Mike
00:53:49.762 --> 00:53:51.902
Thanks for listening to Ctrl-Alt-Speech.
00:53:52.012 --> 00:53:55.521
Subscribe now to get our weekly episodes as soon as they're released.
00:53:56.061 --> 00:54:02.851
If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.com.
00:54:03.052 --> 00:54:05.902
That's CT RL alt speech.com.
00:00:00.179 --> 00:00:28.114
So Jennifer, one of the fun sites on the internet that we'll be talking about a little bit today is Kickstarter, which is the crowdfunding site, and it has a tagline/prompt of"Bring a creative project to life." this is, I will note, the last time ever that we're doing one of these cold opens with a prompt, but we are doing it, and we are using Kickstarter, and I would like to ask you, what creative project would you like to bring to life?
00:00:28.356 --> 00:00:37.637
well, I already did my most you know, favorite creative project when I created, some knit hats out of the fur of my giant Newfoundland dog.
00:00:38.087 --> 00:00:41.936
So you kind of feel like, oh, maybe I peaked in terms of creativity.
00:00:44.097 --> 00:00:44.356
Other
00:00:44.421 --> 00:00:45.021
are amazing.
00:00:45.070 --> 00:00:45.881
have seen them.
00:00:45.881 --> 00:00:46.750
They are amazing.
00:00:46.765 --> 00:00:47.256
Yeah.
00:00:47.856 --> 00:00:51.615
Other people hope I don't go down that creative path ever again.
00:00:52.006 --> 00:01:03.718
But the thing I've actually been thinking about is, there are a lot of people out there who have had sort of, you know, great educations, but kinda limited, like focused on only computer science or engineering or that sort of thing.
00:01:04.097 --> 00:01:14.552
And, you know, they wanna like know more about Western civilization and the great books, but they either didn't have a chance to read them or weren't able to like fully appreciate them when they were just in middle school or high school.
00:01:15.052 --> 00:01:30.581
And my idea is, you know, there's a lot of people out there who are English professors, you know, who are experts in literature, and kind of connecting the people who want to read with the people who have read and thought about the books in sort of like a book group kind of fashion.
00:01:30.581 --> 00:01:40.171
So not a lecturer sort of thing, but like invite a professor to your book group to just be like a friend, part of the conversation, just talk about some of these great books with you.
00:01:40.451 --> 00:01:55.043
I think it's, fun for the, professors to maybe make a little extra money and really valuable for people who are serious about books and about learning about, you know, literature and our tradition and stuff to be able to have, more expertise in a fun situation.
00:01:55.043 --> 00:01:59.983
So that's something I've been thinking about as kinda like a cool sort of, business.
00:02:00.329 --> 00:02:01.450
That's very cool.
00:02:01.590 --> 00:02:07.150
That's, I was expecting a, a more joking answer, but that's that's a very, very cool idea.
00:02:07.150 --> 00:02:08.060
I appreciate that.
00:02:09.272 --> 00:02:12.712
What, what would be your creative project that you wanna bring to life?
00:02:12.758 --> 00:02:19.418
Oh my gosh, I was thinking through this, in terms of I have a long list of creative projects, and so it's like which one do I wanna talk about?
00:02:19.808 --> 00:02:27.723
I have been seriously thinking about, and I think this would be fun to do, to write a novel that is, uh, uh, reflective of the times that we live in.
00:02:27.943 --> 00:02:29.343
There's so much stuff going on.
00:02:29.413 --> 00:02:35.993
I, I have an idea for a, novel that I guess comically comments on, on the world that we live in today.
00:02:36.973 --> 00:02:37.394
I,
00:02:37.400 --> 00:02:47.337
I think that the world could use a little bit of humor while not like, people turn, having to turn a blind eye in order for us to have fun in what is now the real world.
00:02:47.337 --> 00:02:48.807
So I like that idea.
00:02:49.497 --> 00:02:52.578
Um, do you wanna say a little more about how the novel's gonna go?
00:02:53.174 --> 00:02:54.614
I, I, I'm afraid to.
00:02:56.872 --> 00:03:08.066
So, I think, uh, for people who follow me and my writing and everything, I think they would recognize some of the themes, though I might present them in a slightly different form than, than I normally do with, my writing
00:03:08.098 --> 00:03:08.579
Uh-huh.
00:03:08.959 --> 00:03:10.799
I think that the world is waiting
00:03:12.031 --> 00:03:29.251
Excellent Hello, and welcome to Control Alt Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
00:03:29.341 --> 00:03:45.687
It is May the 21st, 2026, and this week we are talking about AI in Africa, online speech choke points, regulators using VPNs, and just how much you're allowed to post on X these days.
00:03:46.193 --> 00:04:03.123
I am Mike Masnick, the founder and editor of Techdirt, with special guest host Jennifer Granick, a civil liberties lawyer previously with the ACLU and Stanford Law, and author of the wonderful book, American Spies, all about the modern surveillance society that we live in.
00:04:03.633 --> 00:04:20.891
I will note this is the last week of Ben's well-earned paternity leave, and he and I will both be back next week, which raises a few important things that are worth mentioning that if you've been listening to the podcast, you should already know, but I feel the need to remind you of them.
00:04:21.071 --> 00:04:22.254
There are changes afoot.
00:04:22.449 --> 00:04:26.189
As mentioned, we went through the last of the opening prompts.
00:04:26.459 --> 00:04:27.480
We are getting rid of that.
00:04:27.569 --> 00:04:28.990
We have run out of prompts.
00:04:29.029 --> 00:04:30.259
We have exhausted that.
00:04:30.819 --> 00:04:40.403
if you are a subscriber to the new Patreon, which you should be, and you can find that at patreon.com/ctrlaltspeech, C-T-R-L-A-L-T speech.
00:04:40.434 --> 00:04:50.307
Uh, if you a subscriber there, you can now access the Control Alt Speech Plus podcast feed.
00:04:50.798 --> 00:05:06.639
If you go to the page and if you view the membership tab, you can get the new RSS feed, which will be important starting next week because part of the podcast will only be available to those who subscribe and support us that way.
00:05:06.810 --> 00:05:11.855
We also have the free podcast, which will be slightly shorter and a little bit different.
00:05:12.266 --> 00:05:29.088
So if you wanna get access to the full continuing podcast like you've had it all along, please go support us, subscribe at the Patreon, and you can go find that RSS feed now and subscribe to it so you'll be ready next week when the episode changes go into effect.
00:05:29.309 --> 00:05:33.011
There should be nothing in that feed right now because we haven't done that.
00:05:33.141 --> 00:05:34.531
It will start next week.
00:05:34.860 --> 00:05:40.338
But you can subscribe now, and you can get your access for starting next Thursday.
00:05:40.338 --> 00:05:47.500
I'll also note that this is the last week to get in at the special founder discount rate for the Patreon.
00:05:48.021 --> 00:05:51.774
once Ben is back, we will still have the offering, but prices will go up.
00:05:51.845 --> 00:05:56.560
So if you wanna be a founder supporter, please do that now.
00:05:56.860 --> 00:06:03.579
we also have a post up on the Patreon right now asking for ideas on our new cold open.
00:06:03.608 --> 00:06:06.819
How do we want to replace that prompt that has grown so tired?
00:06:07.245 --> 00:06:15.723
so you can weigh in and help us figure out what we are going to say and how we are going to open the podcast test, so you can go check it out and share your thoughts.
00:06:16.163 --> 00:06:28.324
And starting tomorrow, we'll be posting the first suggestion box post, for Patreon supporters, where founder-level subscribers can submit links to stories that they would like us to cover.
00:06:28.673 --> 00:06:33.994
So keep an eye out for that starting tomorrow if you are supporting at the founder level.
00:06:34.024 --> 00:06:36.113
So please check out the Patreon.
00:06:36.204 --> 00:06:37.884
We're excited about this.
00:06:37.884 --> 00:06:42.223
This'll be a little bit of an experiment, and we're sort of happy to see what happens there.
00:06:42.613 --> 00:06:47.144
But with that very long intro, let us get to our stories.
00:06:47.454 --> 00:06:53.334
We have, Jennifer, I think you're going to take our first story, which is sort of two stories combined.
00:06:53.625 --> 00:07:04.930
we mentioned Kickstarter in the cold open as the prompt, but we had a story, an interesting story this week involving Kickstarter, and then one involving Apple, but in some ways they're related.
00:07:04.930 --> 00:07:08.031
So do you wanna explain those two stories that you found?
00:07:08.404 --> 00:07:09.105
Yeah, sure.
00:07:09.105 --> 00:07:18.942
So, you know, Kickstarter, recently, made some rule changes about, how it manages, sexually explicit, campaigns, on its site.
00:07:19.372 --> 00:07:34.026
And, it was trying to address a discrepancy between the payment processor Stripe, f- which Kickstarter people use, and their rules about sexually explicit, materials, and Kickstarter's rules, which were a little more liberal.
00:07:34.057 --> 00:07:49.141
They also have regulations, about sexually explicit material, but you know, the devil is in the details, so there was some space there, and sometimes people's Kickstarters were getting frozen by Stripe, and Kickstarter wasn't really able to help them out or unfreeze the funds or that sort of thing.
00:07:49.391 --> 00:07:52.641
So they decided, well, you know, here's our, trust and safety decision.
00:07:52.641 --> 00:07:54.865
Let's, like, close the gap between these two.
00:07:54.865 --> 00:07:57.329
And then, they had to back down from that.
00:07:57.358 --> 00:08:07.184
There was a, cry out from the, Kickstarter users, that this was, not what they wanted and it interfered with their creativity and their, campaigns and that sort of thing.
00:08:07.184 --> 00:08:12.733
And so Kickstarter realized relatively quickly, like,"Oh, okay, this isn't what our people want.
00:08:12.744 --> 00:08:30.177
We need to, like, go back and roll back to our original rules." And then they just have kind of like a makeshift way of trying to manage the problems between what the payment processor Stripe wants and what their rules are and what Kickstarter's own community rules are, and just try to, manage the discrepancy there.
00:08:30.480 --> 00:08:41.715
so you know, here you have a situation where, Stripe is really, influencing or affecting what the preferred rules would otherwise be on platforms for which it just provides payment processing.
00:08:42.123 --> 00:08:54.667
so you know, we can-- we're gonna talk about that, but I think that, the other big story I thought was similar,'cause we're talking about, who gets to control what gets to be done online, and here you have Stripe having this outsized, impact.
00:08:55.047 --> 00:09:27.341
And I think, you know, the other story I wanted to talk about was, about Apple, and ahead of their annual developer conference, they published this overview of the steps that they take in order to protect, users and developers, particularly in the App Store, and this long list of, steps they take and how their moderation and control of the App Store has helped, you know, eliminate, or not eliminate, but decrease fraud, decrease spam, interrupt inauthentic reviews, malware, and those sorts of things, and how this is really beneficial.
00:09:27.341 --> 00:09:41.235
And we know, Apple has this reputation for privacy and security in particular, but Apple has this locked-in ecosystem and, that impacts what people who have iPhones, and use the App Store are able to do online.
00:09:41.556 --> 00:09:53.270
And so here we have two very important, companies, each of which has a outsized impact just based on corporate policies about what users and the public are then able to do
00:09:53.734 --> 00:09:54.083
Yeah.
00:09:54.193 --> 00:10:00.660
I, I thought both of these stories were, were really interesting, and I think it's one of these issues that is less well thought of.
00:10:00.660 --> 00:10:15.456
Like, when people are talking about trust and safety and content moderation decisions, they naturally sort of tend to think specifically about, the big social media companies and, the direct impact of, Facebook deciding what kind of content they're gonna allow, what kind of content they're gonna take down.
00:10:16.015 --> 00:10:26.441
starting with the, the Stripe story, that reveals this sort of hidden layer of infrastructure provider that I think is becoming a bigger and bigger story over the last few years.
00:10:26.744 --> 00:10:42.364
and there, there was actually just a, really good book that came out recently by Rainie Reitman, called Transaction Denied, uh, just came out like a month ago, talking about the payment providers and what kind of impact they have on speech and their ability to, reject speech.
00:10:42.474 --> 00:10:50.962
Often, because they're a layer away from the actual consumer, often in very hidden ways that a lot of users don't even know what's happening.
00:10:51.383 --> 00:11:16.304
and part of what struck me as interesting about the Kickstarter situation was because of the backlash, Kickstarter was actually p- I thought pretty, honest and upfront first saying like,"Yeah, we, we totally fucked this up." but, but then, sort of saying like,"Look, Stripe processes the payments, and they have their rules," and they were, like, killing projects that Kickstarter itself had approved that Stripe said went against their rules.
00:11:16.589 --> 00:11:20.905
and it just, raises a whole bunch of questions about, where is the, power?
00:11:20.946 --> 00:11:49.618
And, I'm sort of curious on your take on this, you know, one of the things that I've been thinking a lot about lately is the fact that the powers that be, for both commercial and political power reasons, have a way of hunting up and down the network stack to figure out where that friction point is to then push on it, in some cases to squeeze out profits and in some cases for political power.
00:11:50.067 --> 00:11:55.474
And I'm sort of curious, how do you view that and th- this sort of hunt for that choke point?
00:11:56.028 --> 00:11:56.139
Yeah.
00:11:56.139 --> 00:12:12.817
I mean, it, it's such a-- it, impacts almost all of the policy conversations we have about the internet, you know, all the way from, like, network neutrality to, copyright you know, infringement interdiction to, questions about what people are allowed to say and do as end users on the platform.
00:12:13.260 --> 00:12:18.359
I think that payment processors have been a underexplored choke point themselves.
00:12:18.649 --> 00:12:36.816
You know, we know, the past there's been concern about how MasterCard and Visa, won't process payments for, sites that are-- have to do with pornography or sex work or, or that sort of thing, and then that becomes kind of themselves having a, a control over, activity online that is potentially lawful.
00:12:37.086 --> 00:12:47.725
and I know, the ACLU filed a complaint with the FTC against MasterCard and Visa for refusing to process payments related to Pornhub or other kinds of sex worker type sites.
00:12:48.051 --> 00:12:50.551
you know, and we have this example with Stripe.
00:12:50.581 --> 00:12:56.552
I think, there are also the efforts to kind of take the regulation down in the stack, like you said.
00:12:56.552 --> 00:13:03.034
And one case I think is really important about that is Sony versus Cox, which was in the Supreme Court just this, little bit ago.
00:13:03.335 --> 00:13:18.846
And Sony, sued, so copyright holders sued an ISP basically saying that Cox needed to, you basically cancel people's accounts when Sony came to it with these takedown demands or with these allegations of copyright infringement.
00:13:19.222 --> 00:13:25.282
and there's a lot of, like, reasons why the case got this far, but it was like a trillion dollar case.
00:13:25.322 --> 00:13:37.511
And the idea is if you can get the ISP to basically block somebody's IP address and not provide them service anymore, yeah, you're doing a great job stopping them from infringing copyright, but you're also stopping them from accessing the internet altogether.
00:13:37.511 --> 00:13:46.562
And not just stopping that person from accessing it, but anybody who uses that IP address, whether it's a household or a library or, you know, a coffee shop or whatever it is.
00:13:46.851 --> 00:13:53.087
So, the regulation when the further down you go, almost it seems like the more, overbroad
00:13:53.505 --> 00:13:53.885
Yeah.
00:13:54.256 --> 00:13:56.476
it's a very blunt instrument at,
00:13:56.548 --> 00:13:58.129
Very blunt instrument.
00:13:58.129 --> 00:14:01.859
Yeah, exactly, and I think that that becomes a real concern.
00:14:02.190 --> 00:14:10.210
you know, instead of looking at an individual's wrongdoing, you look to control it at a centralized point.
00:14:10.515 --> 00:14:16.792
and that centralized point can be very effective but is almost always gonna be overkill
00:14:17.299 --> 00:14:17.669
Yeah.
00:14:18.000 --> 00:14:29.423
And it's interesting to me in a few ways, one of which is that, the founders and, CEO, I don't know if it-- it's two, two brothers founded Stripe, and I don't know if they're like co-CEOs or what, I forget.
00:14:29.832 --> 00:14:40.283
But they have spent many years sort of presenting themselves to the world as, I would say extremely libertarian, free speech supportive.
00:14:40.510 --> 00:14:46.663
you know, they really-- they show up on a lot of these podcasts and discussions about how they're enabling free speech.
00:14:46.943 --> 00:15:05.110
So it struck me as, as somewhat noteworthy then that apparently they're, whether it's for regulatory reasons or for whatever reasons, they're the ones who are the, the sort of prudes, you know, trying to force, force Kickstarter into shutting down certain forms of adult content that, were being funded through them.
00:15:05.580 --> 00:15:15.176
and yet, you know, they sort of stay out of it by, I mean, Kickstarter threw them under the bus, r-rightly so, because it was really their, issue that was happening.
00:15:15.456 --> 00:15:18.155
But it, it strikes me as this thing where...
00:15:18.461 --> 00:15:27.410
Part, part of what I wonder, and I don't know if you know this or not, is like how much of this has to do with the fact that Stripe is in a heavily regulated industry as well?
00:15:27.811 --> 00:15:37.107
Like, once you get into the financial space, they will often come up with excuses about how we have to do like know your customer stuff and because we're all worried about money laundering.
00:15:37.398 --> 00:15:48.962
and there are legitimate concerns there, but I wonder how much of that is used as cover to then be an excuse for saying like,"Okay, no more adult content" or, or anything of that nature.
00:15:49.466 --> 00:15:49.716
Yeah.
00:15:49.716 --> 00:15:52.785
I mean, I think it's, you know, why does this happen?
00:15:52.785 --> 00:16:06.725
And I think any company is going to be impacted by regulation, or fear of regulation and fear of liability, which I think, as you said, is probably much greater in the financial services, than it is in other, areas because it is so highly regulated.
00:16:07.075 --> 00:16:11.932
Money, I mean, the companies, want to make money, and I think that impacts their decision.
00:16:11.932 --> 00:16:24.086
Like Apple had a dispute with"Fortnite," over how much m-money or revenue Apple should make from downloads of the"Fortnite" app, and they had a dispute, and Apple blocked"Fortnite" from the App Store for a while.
00:16:24.383 --> 00:16:26.851
and you can always say, like,"Well, here's why we did it.
00:16:27.022 --> 00:16:30.402
You know, it's, it's not to gain an advantage in litigation.
00:16:30.402 --> 00:16:47.400
It's because they're violating our rules about how you, report your income." You know, in any highly regulated, world or with a lot of rules, you gotta be pretty uncreative if you can't come up with a reason to put a, sanction on somebody.
00:16:47.630 --> 00:16:53.788
Um, and then I think you also have just the kind of the values of the company that are something that, applies as well.
00:16:53.788 --> 00:17:21.553
And so maybe, you know, you can be libertarian but still be really concerned about trafficking, or you can be, you know, And I think, you know, one of the things I've always thought is that a lot of these major companies that we're used to, like, you know, the Apples and the Facebooks and the Googles of the world, started in the United States with lawyers who were trained in the United States with values that were, you know, the values that are inculcated by the legal education you get in the United States, which is like, the Constitution and the Bill of Rights and that sort of thing.
00:17:21.992 --> 00:17:44.262
And as time's gone on and these companies have gotten older and the people have changed and they're global and everything, I think that that sort of underlying ethic is less important now than are the concerns about regulation and public relations and money and, all those other types of, impacts that are, You know, the companies are different.
00:17:44.323 --> 00:17:45.113
They're for-profit.
00:17:45.167 --> 00:17:47.431
they have stockholders that they're responsible to.
00:17:47.431 --> 00:17:57.824
So I think we just don't live in the same world today when it comes to how companies police themselves that we lived in back in, say, like 2015.
00:17:58.000 --> 00:17:58.430
Yeah.
00:17:58.730 --> 00:18:18.979
the other thing that this reminds me of a little bit, and I wonder if this has anything to do with it, is that, it's almost been a decade now since we got FOSTA passed, and we, we saw similar sort of pulling back from, allowing or enabling or assisting with adult content in all sorts of forums where you had, Craigslist shut down parts of its site.
00:18:19.118 --> 00:18:25.616
eBay, you know, suddenly started preventing, the selling of adult-related content in certain categories.
00:18:26.008 --> 00:18:30.050
Famously, Tumblr banned adult content as well.
00:18:30.340 --> 00:18:46.547
And a lot of this was sort of, whether accurate or not, was blamed on FOSTA potentially putting liability on them, even though FOSTA's specifically about sex trafficking, but what counts as facilitating or enabling or assisting in sex trafficking is, was unfortunately broad in the way the law was.
00:18:46.873 --> 00:18:51.776
D- do you think that any of this could be sort of a specific regulatory response to something like that?
00:18:52.215 --> 00:18:53.326
I don't know.
00:18:53.425 --> 00:18:58.036
I do think that there's a general sense of like, why take the chance?
00:18:58.036 --> 00:18:58.945
You know what I mean?
00:18:58.945 --> 00:19:06.989
If a small part of your revenue is based on, this type of content, and you don't need that revenue, but the potential risk is high.
00:19:06.989 --> 00:19:27.122
I mean, this is one of the reasons why we are so concerned about regulation, uh, you know, overall, is because it does tend to have just, basically every time we see that these regulations have a outside effect where it encourages more takedown and over-censorship than what the actual text could be read to, say.
00:19:27.531 --> 00:19:27.988
So it's,.
00:19:28.038 --> 00:19:31.228
You're going to have these situations where too much stuff is caught in the net
00:19:31.778 --> 00:19:32.127
Yeah.
00:19:32.336 --> 00:19:33.522
So I wanna talk a little bit more...
00:19:33.522 --> 00:19:37.615
We've been focusing on the Kickstarter part of it, but I wanna talk a little bit more about the Apple side of the story.
00:19:37.615 --> 00:19:38.556
Apple's a little bit different.
00:19:38.556 --> 00:19:40.546
That's obviously a little bit more consumer-facing.
00:19:40.904 --> 00:19:43.525
and, you know, the Apple announcement is, is really interesting, right?
00:19:43.525 --> 00:19:53.088
I mean, they're sort of talking about all of this stuff that they've blocked, and, and they're sort of very proudly talking about, preventing$2.2 billion worth of fraud and,
00:19:53.244 --> 00:19:53.795
of fraud.
00:19:54.028 --> 00:20:05.517
yeah, and, you know, and dangerous apps and account ki- You know, there's, the sense here in this announcement is basically like Apple's protecting you, Apple's protecting the world, Apple's making the world safe.
00:20:05.740 --> 00:20:08.516
And there is value in that, right?
00:20:08.566 --> 00:20:15.700
I mean, imagine the headlines if there was 2.2 billion more worth of fraud and it was happening on, on iPhones or whatever.
00:20:16.162 --> 00:20:23.864
but, like, I'm sort of balancing that with the fact that then we're also sort of trusting this one company to sort of police these things and, protect us.
00:20:24.023 --> 00:20:31.270
So I'm sort of curious, like, where do you come down on, like, they're protecting us versus there's sort of a police state element to it?
00:20:31.846 --> 00:20:32.885
Yeah, absolutely.
00:20:32.885 --> 00:20:39.346
I mean, there's a thing with Apple is there's this, you know, it's extremely popular platform, but there's a centralized point of failure.
00:20:39.603 --> 00:20:52.269
and so you have this like choke point, again, where it's very effective to target the company for censorship or the company's own censorship decisions impact, all these users.
00:20:52.269 --> 00:21:11.876
So, we had recently a case where there are people develop these apps in order to keep track of ICE agents or to monitor ICE agents' activity on the streets of Minneapolis and other places during the ongoing crackdown, on people who, they suspect of being, here without proper authorization.
00:21:12.217 --> 00:21:23.490
And, Apple, basically took down a number of these ICE watch-type applications, and then a day later, Google took these apps o-out of Google Play Store as well.
00:21:23.779 --> 00:21:24.960
So you have this point of failure.
00:21:24.960 --> 00:21:32.180
The government comes to them, they give them some co- you know, to say like, you know,"We're expecting you to do this," and then they do.
00:21:32.594 --> 00:21:37.061
and since Apple is a global store, they h- do this in other countries as well.
00:21:37.061 --> 00:21:52.142
Like there's an example where, Apple's made a lot of accommodations to operate in China and the Chinese government, had Apple remove gay dating apps from the App Store based on their own, ideas about what is or is not appropriate.
00:21:52.491 --> 00:22:01.124
So, when you have a central point of failure like that, you have a, right there that, you know, this is where a coercive government or whatever is gonna focus their attention.
00:22:01.513 --> 00:22:04.194
So, I think in some ways it can be a trade-off.
00:22:04.493 --> 00:22:15.035
I hear my colleagues at the ACLU telling me that security doesn't require a closed ecosystem that is impenetrable, and I believe that.
00:22:15.088 --> 00:22:25.098
but I also think that the way Apple has set things up and the way they do end-to-end encryption in their iCloud backups and that sort of thing, that they provide a lot more security than other platforms do for people.
00:22:25.516 --> 00:22:29.268
it's not the only way, but here the way they've set it up, there is this trade-off.
00:22:29.268 --> 00:22:30.948
It makes Apple extremely powerful.
00:22:31.347 --> 00:22:34.121
And same thing with, Cloudflare, right?
00:22:34.121 --> 00:22:35.851
Where you have a single point of failure.
00:22:35.851 --> 00:22:39.404
There's something that, and, these companies are under pressure.
00:22:39.404 --> 00:22:56.125
They have the values of their founders or the, you know, and that I think is a really scary world to live in where you have these weaknesses in the infrastructure of the most important technology for communications and business activity of our time.
00:22:56.638 --> 00:22:56.969
Yeah.
00:22:57.259 --> 00:23:13.297
I mean, one of the lines that we will repeat over and over again on this podcast is, what believe Charlotte Wilner came up with, which was that, trust and safety could also stand for trade-offs and sadness because it's, it's all trade-offs and sadness.
00:23:13.297 --> 00:23:15.176
There's no, there's no right answer.
00:23:15.416 --> 00:23:32.642
Each approach, you know, there are incentives and reasons why things happen these ways, and when you have large centralized choke points, That's very helpful for, certain aspects of security, but also they become targets and, and there then are questions about who has control over those choke points.
00:23:32.642 --> 00:23:41.788
And so I think these two stories both are, are really good at, at highlighting that issue and how, uh, you know, I don't think either of us are saying that one approach is the right approach.
00:23:41.788 --> 00:23:49.717
It's just sort of making clear what is often not as well thought about, which is that there are always these choke points, and they're not always the most obvious ones.
00:23:50.164 --> 00:23:50.605
Yeah.
00:23:50.884 --> 00:23:54.029
I mean, I think the answer there,'cause you're right, there's trade-offs.
00:23:54.029 --> 00:24:09.063
But I think the answer there is for when the trade-off is made, the decision has been made, Apple's gonna have this closed ecosystem, we try to minimize the downside, by bringing a strong public advocacy against Apple when it makes censorship decisions.
00:24:09.093 --> 00:24:24.834
So, you know, sort of name, shame, blame, pressure, complain, you know, and, and h- so that when this happens again the next time, Apple thinks, there is some cost to us making this, this censorship decision.
00:24:25.045 --> 00:24:30.781
and we try to bring that through, you know, whether it's FTC complaints or, public advocacy.
00:24:31.066 --> 00:24:39.108
I think that we don't have to accept all of the downsides of the trade-off as citizens.
00:24:39.492 --> 00:24:44.750
Yeah, I mean, I think part of the discussion of the trade-off is how do you m- you know, minimize the downsides.
00:24:44.780 --> 00:24:47.411
That doesn't get rid of the trade-off, but allows you to, you know...
00:24:47.570 --> 00:24:53.057
But that also involves some level of transparency and, openness and discussion about what those actual trade-offs are.
00:24:54.096 --> 00:24:56.144
Right
00:24:56.249 --> 00:24:56.989
story.
00:24:57.078 --> 00:25:08.209
you know, one of the things we've been following over the last few years obviously is the Online Safety Act in the UK and Ofcom, and they've been, beginning to do some enforcement actions there.
00:25:08.568 --> 00:25:13.798
And, There were a few announcements this week, including one with, X, but I'm gonna leave that one aside.
00:25:14.238 --> 00:25:25.268
But there was another one against a, an even more controversial site, if you can believe that, than X, which is the site that is known as Sanctioned Suicide, sometimes referred to as SASU.
00:25:25.869 --> 00:25:29.354
obviously this is, uh, a very, very sensitive issue.
00:25:29.354 --> 00:25:39.537
Obviously, whenever you're talking about anything having to do with suicide, it is a tricky issue to talk about for a variety of reasons, and Sanctioned Suicide is a site that has been around.
00:25:39.537 --> 00:25:40.757
It's very controversial.
00:25:40.797 --> 00:25:42.926
It has been banned in a number of countries.
00:25:43.297 --> 00:25:50.646
There have been attempts within various states in the US to see if they can ban it, though the First Amendment basically should not allow that.
00:25:50.797 --> 00:25:54.093
Well, there may be some, some court cases that test that at some point.
00:25:54.411 --> 00:26:06.192
and so it, it's an extremely controversial site, and Ofcom effectively went after them and this week issued a£950,000 fine against Sanctioned Suicide.
00:26:06.615 --> 00:26:27.281
and the, thing that struck me as very interesting is one of their lawyers, Preston Byrne, who's been very vocal on this subject and specifically on pushing back against Ofcom enforcement, that he feels or his clients feel or, know, reaches into the US where they should be protected and, and they're not subject to UK laws.
00:26:27.647 --> 00:26:39.150
he wrote a very long and detailed post sort of pushing back on Ofcom's fine, and in fact noting that part of the explanation of their fine was that they had to use a VPN.
00:26:39.596 --> 00:26:43.469
And so I'm not gonna go into the full background of the story'cause it is very long.
00:26:43.469 --> 00:26:44.778
We'll have a link in the show notes.
00:26:45.138 --> 00:26:59.396
But effectively, there was conversations between Ofcom and Sanctioned Suicide last year, and Sanctioned Suicide appeared to take it seriously and put in place a geo-block to effectively try and block people from the UK from reaching the site.
00:26:59.886 --> 00:27:15.359
There was some sort of h- you could kind of get around it through a system where if you had already created an account before they put in place the geo-block and you used a VPN, you could reach some aspect of the site.
00:27:15.390 --> 00:27:21.647
There was something a little bit confusing with a sort of anti- spam provider that they use, that you could still access that.
00:27:21.968 --> 00:27:48.517
But the end result was that it was very difficult to reach the site if you were in the UK, and they had put in place, tools and blocks, and Ofcom had originally indicated that this was an acceptable approach, but then changed their mind and issued this fine, and somewhat amusingly, to me at least, you know, sort of revealed within the, the details of the fine that they issued that they had to use a VPN to, reach the site.
00:27:48.946 --> 00:27:56.272
Even though they claimed that the VPN was not effective, they still had to use it in order to reach the site and to describe what, what kinds of content they found.
00:27:56.673 --> 00:28:09.400
And, Preston Byrne sort of describes in his post that like,"Look, we did geo-block it, and you said it was okay," and you're sort of using these tricks that, yes, eventually anyone can get around them, but you have to be sort of technically savvy.
00:28:09.839 --> 00:28:18.965
And really, what the notice from Ofcom proves is that the geo-blocking was somewhat effective because they had to use the, use a VPN to get around it just to issue the fine.
00:28:19.520 --> 00:28:23.912
So, Jennifer, I'm, I'm sort of curious, what did you think of this story and everything that was happening here?
00:28:24.439 --> 00:28:35.142
Well, you know, I think, I think as a lawyer, I immediately sort of thought about how you are engineering your, jurisdiction over the site, because here they are basically saying,"We opt out.
00:28:35.142 --> 00:28:36.372
We don't wanna do business.
00:28:36.372 --> 00:28:45.362
We're not doing business in your country." And it's like, but the internet is global, and it's possible some way or another, it routes around censorship, right?
00:28:45.362 --> 00:28:50.319
It's possible some way or another to get in touch with the site from, the UK.
00:28:50.609 --> 00:29:08.101
And it's just interesting to me, just sort of, basically what that means is that any website is subject to the jurisdiction, theoretically, of every country on the face of the planet, even if you try to stop that from happening and, you know, target countries specifically where what you're doing is lawful.
00:29:08.439 --> 00:29:13.419
and it is, you know, a problem similar to centralization.
00:29:13.419 --> 00:29:27.303
This globalization of companies is a problem because, every country that comes in with whatever their rules are, eventually you kind of devolve to, like, the lowest, common denominator of just only what's legal everywhere.
00:29:27.688 --> 00:29:40.842
and then the special protections or values or whatever that different countries might have are, kind of ineffectual if you have to obey, anyone who can get in touch with your site with a VPN, which is basically everyone.
00:29:41.304 --> 00:29:57.785
it feels like-- or not feels like, I mean, I think legally it's true, but also I think it's important that websites that have lawful content be able to operate in the world, at least for the people who, live in the countries for which it's lawful.
00:29:58.045 --> 00:30:05.669
I still don't love that because I think it's fragmented, you have your, like, balkanized personal, country internet, which isn't really a great thing.
00:30:05.669 --> 00:30:11.088
It's supposed to be a global network where we can all communicate with each other and get information.
00:30:11.431 --> 00:30:18.134
but at the very least, sites should be able to operate in their particular jurisdiction without kind of a,"I got you," you know?
00:30:18.753 --> 00:30:21.903
"Ha ha," you know, with by accessing it with a VPN.
00:30:22.576 --> 00:30:30.537
another concern I have is just, like, to more effectively block users from certain countries, I think is a bit of a surveillance nightmare.
00:30:30.753 --> 00:30:39.910
and we've seen this in other contexts, like with, gambling apps or whatever, to try to figure out and make sure that the users are in a jurisdiction where online gambling is permitted.
00:30:39.910 --> 00:30:44.119
There's a lot of location tracking, um, providing your identification.
00:30:44.119 --> 00:30:58.808
So it's just, techniques that really interfere with people's privacy, people's anonymity, and, can put the users or visitors, posters to a site in some jeopardy because this identifying information about them is being collected.
00:30:58.808 --> 00:31:13.398
And I think that there's this real push, tracking IP addresses or more, in order to make these geo bans more effective, and that it's a real worry for me as a surveillance lawyer that that's also, like, a side effect that we're heading down the road towards.
00:31:13.753 --> 00:31:15.223
Yeah, I, I think it's a real issue.
00:31:15.223 --> 00:31:22.950
I mean, it, it's funny to me, I've talked about this before, but, Techdirt started in 1997, so we're 29 years in, which is insane.
00:31:23.259 --> 00:31:23.609
But
00:31:24.560 --> 00:31:26.710
You should be very proud.
00:31:26.929 --> 00:31:29.679
Wait till we get to 30, okay?
00:31:29.989 --> 00:31:42.025
But, but, but one of the things that, that was, like, a common theme in our very first year was specifically this issue of, jurisdiction, that, pre-internet, jurisdiction was much easier.
00:31:42.025 --> 00:31:47.984
I wouldn't say it was easy, but it was much easier to determine because it was where you were, where the thing happened.
00:31:48.325 --> 00:31:58.775
And as soon as the internet came about and suddenly just, you know, wiped out borders in terms of what was available where, the jurisdiction questions were, like, one of the biggest things.
00:31:58.954 --> 00:32:02.545
And we're now 29 years later, and we still haven't figured that out.
00:32:02.615 --> 00:32:11.766
And we're still sort of sorting through what does all that mean, and we still don't seem to have really good answers for, like, how do you handle global internet with different local laws?
00:32:12.145 --> 00:32:27.526
And, it's fascinating to me that this issue so many years later, like, there are attempts, and as you said, like, some of the, fallout is that we have a really fractured internet in a lot of ways, which I, I don't think is a good thing, or that we have a lot of surveillance, which also I don't think is a good thing.
00:32:27.996 --> 00:32:35.398
But it still feels like we're still struggling with this question of, you know, how do you actually handle legal jurisdiction on a global internet?
00:32:35.638 --> 00:32:36.916
And, Yeah, it's weird.
00:32:37.618 --> 00:32:38.578
It is weird.
00:32:38.608 --> 00:32:45.527
I mean, you know, my first year of law school, you do civil procedure and you go over jurisdiction, and it's like a big yawn.
00:32:45.896 --> 00:32:49.696
Um, I think I can say probably most people felt that way.
00:32:50.037 --> 00:33:03.240
And then some of the earliest cases I did, you know, I did one case which was about a website that was a CNN spoof website, and the client, just basically lived in Massachusetts or something like that.
00:33:03.510 --> 00:33:18.317
Um, and CNN is, was headquartered in Georgia, and they sued him in Georgia, and he didn't have anything in Georgia, but the court was like: Well, you targeted CNN, and CNN is in Ge- you know, how can it be in something?
00:33:18.317 --> 00:33:23.448
But CNN is in Georgia, so we had this big jurisdictional battle, and they're like: No, you can be sued here.
00:33:23.712 --> 00:33:56.310
or like in the Lori Drew MySpace case, you have somebody who is, doing something that's not illegal, under state law, but they can be, brought into federal court in a different place because, the conduct happened over MySpace, and MySpace is located in a totally different jurisdiction, which allows, you know, the thing there I think is it allows, prosecutors to kind of pick and choose a little bit, so you have the most, aggressive prosecutors can kind of pick cases, you know, from, things that people do around the country.
00:33:56.570 --> 00:34:06.440
And now you have that with countries, like around the world, where you can have the most aggressive regulator can kind of pluck somebody out and be like: Yes, you guys are the ones that we're gonna go after.
00:34:06.852 --> 00:34:14.057
and you know, I mean, I, I think y- I have to recognize as a lawyer, like nowadays, I don't think the law is the most important thing that decides that.
00:34:14.097 --> 00:34:15.378
I think it's the assets.
00:34:15.777 --> 00:34:16.088
You know?
00:34:16.088 --> 00:34:22.998
And it's like if you have people or you have property in the country, then you're subject to their jurisdiction.
00:34:22.998 --> 00:34:27.047
And I often, you know, had had people come to me and be like: What's the rules here about this?
00:34:27.047 --> 00:34:28.617
I'm like: Well, do you have people on the ground there?
00:34:28.617 --> 00:34:29.047
They're like: Yeah.
00:34:29.047 --> 00:34:31.568
I'm like: Do you wanna let those people go to prison?
00:34:31.757 --> 00:34:34.117
"No." Okay, well then they have jurisdiction over you.
00:34:34.458 --> 00:34:39.561
So, so, you know, if you're gonna do business someplace, gonna h- have that trouble.
00:34:39.730 --> 00:34:54.458
I was gonna say that's also why certain countries are now putting in place what I refer to as hostage laws, which is requiring if you wanna operate in this country, you have to have an employee on the ground, which, you know, their only real role is to be threatened to be put in jail if
00:34:54.514 --> 00:34:55.293
know.
00:34:55.528 --> 00:34:57.639
uh, which is sort of horrifying in some ways.
00:34:57.639 --> 00:34:58.590
But it, it, kinda
00:34:58.699 --> 00:35:01.230
I would love to see the job posting for that.
00:35:01.280 --> 00:35:04.369
And then also, like, what's the interview like?
00:35:04.369 --> 00:35:04.929
You know?
00:35:05.340 --> 00:35:06.989
Do you, do you like gruel?
00:35:07.019 --> 00:35:10.170
How many days can you survive on gruel?
00:35:11.211 --> 00:35:11.592
Yeah.
00:35:11.992 --> 00:35:12.722
Oh my God.
00:35:13.492 --> 00:35:15.608
Um, I mean, I'm sure they have some sort...
00:35:15.610 --> 00:35:18.079
it's like when you work in the CIA, you have a cover story.
00:35:18.219 --> 00:35:23.630
I assume that there's some sort of job description which is not technically just be here to go to prison.
00:35:25.628 --> 00:35:26.898
But I, I don't know.
00:35:27.139 --> 00:35:27.588
I don't know.
00:35:27.809 --> 00:35:36.460
I mean, what, like, given that, Sanction Suicide put in place this geo-block, and it appears they went to sort of pretty great lengths to actually try and make the geo-block effective.
00:35:36.706 --> 00:35:44.849
what else would you think that a site like that should do to say like,"Look, we're not targeting your jurisdiction at all." Like, is there anything else that they can do?
00:35:45.422 --> 00:35:59.516
I mean, you know, I mentioned some of the more intensive surveillance things that you could do, you know, in terms of requiring users to prove location basically before they're a-accessing the site.
00:35:59.916 --> 00:36:05.728
Um, and I think that that can be some pretty, risky and dangerous information collection.
00:36:05.829 --> 00:36:23.438
But I don't know that, I'm sure like technically, and I'm sure that there are tons of, cryptographers who are working on ways where you can have like an attestation like this person is not in this country, and have that be something you can rely on without collecting all this other information.
00:36:23.438 --> 00:36:35.150
And I hope that tools like that will be developed so that if we need to have these things, we can have these things without it also being, and this user is Jennifer Granick, and she is, you know, all that other stuff.
00:36:35.405 --> 00:36:35.706
Yeah.
00:36:36.456 --> 00:36:41.556
All right, well, let us move on to our more lightning round set of stories.
00:36:41.556 --> 00:36:44.440
Uh, and this one, there's a nice sort of, segue.
00:36:44.943 --> 00:37:01.432
this is a story from Rest of World, talking about how various African countries are trying to figure out their AI policy, and one of the things that, multiple countries are recognizing is how reliant they are on US-based companies and US-based infrastructure.
00:37:01.753 --> 00:37:14.242
And suddenly these legal questions of, well, how does the law here apply to companies based there, are having a really big impact in, in terms of how these countries are thinking about their AI policy.
00:37:14.242 --> 00:37:20.951
And one of the things that many of these countries in this article, they, they cover Nigeria, Egypt, Kenya, South Africa.
00:37:21.121 --> 00:37:37.364
Though the aside on South Africa is that their AI policy had to be withdrawn last month when people discovered, a researcher actually discovered that the citations in the policy on how to deal with AI appear to have been hallucinated by AI.
00:37:38.563 --> 00:37:39.784
That will be revisited
00:37:39.833 --> 00:37:41.222
can't make this stuff up.
00:37:41.782 --> 00:37:44.092
That's gotta, that's gotta go in your novel.
00:37:44.344 --> 00:37:46.753
Yeah, yeah, something like that.
00:37:46.753 --> 00:37:47.563
Definitely should.
00:37:48.072 --> 00:37:48.893
Make a note.
00:37:49.143 --> 00:37:49.764
yeah.
00:37:50.400 --> 00:38:07.936
but you know, what's, what's interesting is, these countries are suddenly sort of trying to figure out how to deal with that, and one of the things that many of them are pushing for within these policies, you know, whether or not it's realized is still to be determined, is that there needs to be more local sovereignty, data sovereignty.
00:38:07.936 --> 00:38:20.706
Data should stay within these countries, and they, even if they're doing agreements with American companies, that there needs to be some level of control over the data and keeping it local within the countries, which then raises a whole bunch of other issues.
00:38:20.706 --> 00:38:28.367
And we've had this in, in other data localization context where if the data is local, that also means it may be accessible.
00:38:28.396 --> 00:38:39.297
So if a government wants to do surveillance on you, a requirement to keep it local you can say is to protect privacy, but it also may give access to the police or whoever else.
00:38:39.597 --> 00:38:47.567
So I'm sort of curious, what was your take on, on this particular story about the African countries and trying to figure out how to deal with American AI infrastructure?
00:38:48.172 --> 00:38:48.302
Yeah.
00:38:48.302 --> 00:39:08.916
I mean, you know, sovereignty sounds great, and I do think that it makes sense that countries want to be able to, have technology accord with their own laws and values and that they don't necessarily want a big for-profit American corporations deciding what's good and what's bad for people.
00:39:09.206 --> 00:39:10.755
And I agree with that.
00:39:10.786 --> 00:39:25.905
You know, I think that, when you have the rules and the, constraints about what a product like AI can do that are decided by for-profit companies, it's gonna be a certain thing, and there are gonna be other values that go by the wayside.
00:39:25.934 --> 00:39:34.521
Like this whole discussion of AI safety as being like the primary motivation or, you know, the primary like, value added by a company.
00:39:34.521 --> 00:39:39.420
It's when you have such a highly competitive industry, nobody's gonna slow down for safety.
00:39:39.420 --> 00:39:43.096
It's just obviously, it was never true.
00:39:43.275 --> 00:39:46.106
Obviously never true from the, from the beginning.
00:39:46.565 --> 00:39:51.909
Um, and I think that it makes perfect sense that countries would want to, do something, different.
00:39:51.909 --> 00:39:59.043
And I think this is important because for me, one of the issues here is like, AI isn't just information or something somebody says.
00:39:59.043 --> 00:40:07.677
AI is, is something that it does things, and that functionality I think can often and often should be regulated.
00:40:07.677 --> 00:40:09.768
So that makes a lot of sense to me.
00:40:10.217 --> 00:40:26.277
but you know, we, as we talked about before with, the balkanization of the internet and with how, you get the lowest common denominator, of regulation when any country is the decider about what, a tool can be used for, what people can say or do with it.
00:40:26.574 --> 00:40:34.628
this is the issue I think we're gonna have here, with the idea that, you know, we have sovereignty over a particular, tool.
00:40:34.838 --> 00:40:39.599
it is another one of these, trade-offs, yeah, just another one of these trade-offs
00:40:40.193 --> 00:40:41.153
No, it, it's tricky.
00:40:41.153 --> 00:40:57.726
I also think, I mean, there's another trade-off within what you were talking about, which, uh, is trickier than I think most people recognize, which is you talked about the difference between sort of speech and conduct, which is sort of usually the dividing line between, you know, speech is more protected, against regulation, versus conduct.
00:40:58.139 --> 00:41:11.079
But it's not as clear where that border is, especially with, tools like software and AI, the switch from what is speech to what is actually conduct, it would be nice if there was a clear dividing line.
00:41:11.909 --> 00:41:13.900
I'm just not convinced there really is.
00:41:14.398 --> 00:41:15.748
No, there isn't.
00:41:15.748 --> 00:41:24.347
It keeps the, it keeps the speech lawyers occupied litigating what is that, what is that line.
00:41:24.735 --> 00:41:30.733
and you know, I mean, we're dealing with that you know, I mean, I don't wanna take us down a different but favorite road.
00:41:30.733 --> 00:41:38.844
We deal with that in the context of, Section 230 between what is, the activity on a platform and what is speech on the platform.
00:41:38.875 --> 00:41:50.393
What is when the platform, chooses what information or prioritizes particular information for us to see, is that like, functionality of the platform or is that the platform's speech?
00:41:50.393 --> 00:41:51.684
Is it the third party's speech?
00:41:51.684 --> 00:42:07.242
And we filed when I was at the ACLU, we filed a brief about this in the, Gonzalez versus, Google case discussing, what is speech in terms of how the, platform operates to prioritize particular content.
00:42:07.523 --> 00:42:29.923
But we tried to distinguish that in the brief from things that the, company does to prioritize content when what it's doing is only showing, men the most lucrative jobs or only showing white people these set of houses or, you know, sort of a, online but still discrimination that would be illegal offline.
00:42:30.193 --> 00:42:45.356
And so how do you think about, the difference between here's what you, Jennifer, might like to see and here's what you white people deserve to have in your education and housing and credit, portfolio?
00:42:45.902 --> 00:42:51.356
Yeah, I, we don't have time to go deep into this, but yes, it is like all, with all of these things, right?
00:42:51.356 --> 00:42:52.297
It is a really...
00:42:52.547 --> 00:43:11.648
You know, there are things that are clearly problematic and where there are laws against them, but you have to be very careful wading into the areas where, you know, it's easy to say,"Well, this is conduct, this is speech," but the lines are very, very blurry, and that, that's where, uh, there's a lot of litigation and keeps lawyers like you plenty busy.
00:43:12.291 --> 00:43:13.211
Yeah, totally.
00:43:13.211 --> 00:43:17.382
And I can understand why different countries wanna have that, you know, idea too.
00:43:17.382 --> 00:43:25.362
Like, we want tools to operate in the benefit of our citizens, and so here's how we want it to be.
00:43:25.362 --> 00:43:37.349
Of course, as I'm saying it, it's like the most optimistic view of sovereignty because we also know that not all governments are like,"Well, let's-- what's good for our citizens?" A lot of governments are like,"What's good for me?
00:43:37.380 --> 00:43:52.889
Can I use this deepfakes takedown law in order to get bad stuff about me, the president, taken offline?" And so, you know, not-- we can't trust that everyone is really c- every government is really concerned about free speech and their citizens.
00:43:52.980 --> 00:43:54.579
I don't know why that was the example
00:43:54.634 --> 00:43:59.364
was going to say that was a fantastic segue to our next story.
00:43:59.664 --> 00:44:04.010
So d- which is that, yes, the Take It Down Act is now in effect.
00:44:04.010 --> 00:44:05.141
Do you wanna talk about that?
00:44:05.585 --> 00:44:05.715
Sure.
00:44:05.715 --> 00:44:11.956
I mean, this is a law that was signed about a year ago and is now fully in effect.
00:44:11.956 --> 00:44:20.188
The Take It Down Act was, intended to address the, um, problem with non-consensual intimate imagery or NCII.
00:44:20.623 --> 00:44:29.505
and, this includes, not just, images of real people, but also, what we call deepfakes or AI-generated, images.
00:44:29.545 --> 00:44:34.755
I think deepfakes suggests we can't tell the difference between them and real, but they're really just fakes.
00:44:34.784 --> 00:44:39.144
So I don't know how deep it is or whatever, but it's called deepfakes.
00:44:39.465 --> 00:44:53.228
And the law sets up a notice and takedown, process where if a platform gets notification that there is some NCII on it, then there's a 48-hour turnaround to take the, uh, information offline.
00:44:53.579 --> 00:45:05.208
And we know from, in other notice and takedown regimes like the Digital Millennium Copyright Act, that these regimes tend to create a, over-incentive to take things down even if they're lawful.
00:45:05.518 --> 00:45:06.628
The company doesn't know.
00:45:06.628 --> 00:45:09.358
It doesn't have time to, ask questions or...
00:45:09.635 --> 00:45:18.436
and so these, regimes can be weaponized to take down information that maybe has nothing to do with NCII.
00:45:18.815 --> 00:45:31.514
and so not only do you have a problem that maybe the law is overbroad as to what should be taken down, that's a problem, but also that in practice, the takedowns will be broader even than that interpretation of the law.
00:45:31.768 --> 00:45:42.903
and just recently, the chair of the FTC, wrote to a bunch of the large platforms, large and medium platforms, saying,"You know, we're gonna start enforcing this, so you guys better be doing it.
00:45:43.114 --> 00:45:55.782
There are huge fines at stake." but there's, like, explicit statements by President Trump that he plans to use this law to try to get, critiques, and negative information about himself, taken offline.
00:45:56.072 --> 00:46:02.733
and that's just so interesting because I think there's just a very, very limited amount of NCII about President Trump.
00:46:02.733 --> 00:46:03.663
I mean, I don't know.
00:46:03.663 --> 00:46:05.572
Maybe I just run in the wrong circles.
00:46:05.612 --> 00:46:07.092
Um, so it seems like,
00:46:07.710 --> 00:46:22.494
the, the, the example, and we, we had an article on Techdirt about this last year, was that, South Park in its last season often had, images of a, AI-generated video of a naked Donald Trump.
00:46:22.755 --> 00:46:26.702
and so the question was, would that violate the Take It Down Act?
00:46:26.952 --> 00:46:43.106
When it's broadcast on TV, it's protected, but when it's on the internet, and their videos have been posted on the internet, does that suddenly trigger an issue that Donald Trump could use the Take It Down Act to demand that YouTube take down, say, South Park videos?
00:46:43.652 --> 00:46:45.552
So A, God bless South Park.
00:46:45.911 --> 00:46:50.672
B, obviously I underestimated the market for Trump NCII.
00:46:50.672 --> 00:47:06.829
And then, you know, C, I think this is something, you know, at the ACLU we really worried about when the bill was, introduced, which is there are really not safeguards for political satire or critique or, you know, that sort of protected speech.
00:47:06.829 --> 00:47:25.606
And there's no thing here like you have to necessarily, like, believe it is a video of a real person, and so that, leaves open to this concern, that political critique can be, targeted under this law, and failure to take it down can result in real liability.
00:47:26.034 --> 00:47:30.034
the related thing, I mean, you mentioned the FTC has been very vocal in talking about this.
00:47:30.382 --> 00:47:49.710
it should be noted that the chair of the FTC, Andrew Ferguson, has been pretty open about choosing his targets based on partisanship, and he has opened a bunch of investigations that were clearly done to, suppress speech and create chilling effects from those who are critical of Donald Trump.
00:47:49.739 --> 00:48:05.594
There was a whole investigation into media matters, and more recently there was the invest- not investigation, but there were, civil investigative demands, which are subpoenas into NewsGuard, which was a company which was run by a, a, a fairly conservative guy.
00:48:05.994 --> 00:48:21.246
But, Newsmax became very upset because they were ranked low for trustworthiness in NewsGuard, and so suddenly the FTC started investigating NewsGuard, and it was clearly just a partisan free speech suppression kind of situation.
00:48:21.496 --> 00:48:40.141
So the fact that the FTC gets to enforce this law, I think it's going to be really worth watching who it is they go after and what reasons, because lots of people would argue that, what Grok was doing on X with its AI image generation, could have violated some aspects of the Take It Down law.
00:48:40.561 --> 00:48:50.222
and so would a Trump FTC go after X for violating this law when Elon Musk and Donald Trump are on good terms?
00:48:50.621 --> 00:48:52.972
And that's gonna be something worth watching.
00:48:53.411 --> 00:49:07.150
I think, you know, theoretically we kind of pose or I kind of posed the question of do you want this for-profit corporation to regulate or do you want this government, with their own sort of censorship and politics and whatever to, to govern?
00:49:07.501 --> 00:49:23.025
And I think that that kind of philosophical, debate has to actually take place in the context of what are we really seeing, which is, here in the United States, we have a government that has been weaponized against ideological and political opposition.
00:49:23.474 --> 00:49:45.307
And, it's kind of great having been a First Amendment lawyer for so long that we can ni- finally say to people,"See, this is what we told you that you have to be worried about, and this is why we pushed for all those rules that you didn't like because, you know, you thought the government was gonna be a good actor." And in theory, sure, that's nice.
00:49:45.307 --> 00:49:46.208
They're helping the public.
00:49:46.577 --> 00:49:50.217
But in practicality, this is what happened, and we turned on a dime.
00:49:50.387 --> 00:49:52.777
You know, historically, our government's turned on a dime.
00:49:53.117 --> 00:49:59.088
And so I think absolutely right when you think about these things, you can't really think about it anymore in the abstract.
00:49:59.088 --> 00:50:01.757
You have to think about it as like, look, this is playing out.
00:50:01.788 --> 00:50:08.677
Our worst fears, our worst nightmares are playing out in reality here in the United States of America.
00:50:08.677 --> 00:50:11.338
And so, you know, this is what we're seeing.
00:50:11.338 --> 00:50:17.085
And so having empowered the government to make these decisions we're reaping what we've sown.
00:50:17.376 --> 00:50:17.706
Yeah.
00:50:17.945 --> 00:50:18.155
Yeah.
00:50:18.186 --> 00:50:19.835
So that's definitely one that we'll be following.
00:50:20.365 --> 00:50:24.405
Our final story, we are running low on time, so we'll make this one quick.
00:50:24.782 --> 00:50:32.565
we-- for the most part, I mean, I mentioned here and there, we have avoided talking about X and Elon Musk this week, except for this last story, which again will be really quick.
00:50:32.795 --> 00:50:43.034
But X has changed its policies that, you know, Elon Musk took over the site and promised to bring free speech back, and it was going to be the, free speech platform, the center of the world for speech and all this stuff.
00:50:43.463 --> 00:50:49.177
And apparently, they have now put in place rules that, if you really wanna speak, you kinda have to pay.
00:50:50.067 --> 00:50:55.327
So there are limits on how much you can now tweet before you have to pay.
00:50:55.327 --> 00:51:03.711
So you can do 50 posts a day or 200 replies a day, and if you d- haven't paid and you don't have a blue check mark, you can not go above that.
00:51:04.282 --> 00:51:09.443
Now, some people will argue, and you might argue, that 50 posts is, that's a, it's a lot of posts.
00:51:09.552 --> 00:51:11.833
200 replies is, is a lot of replies.
00:51:11.862 --> 00:51:15.402
That should work for most people, and probably does work for most people.
00:51:15.402 --> 00:51:32.266
But I could definitely see, you know, people who are commenting on sports or news or whatever, if there's like a breaking story, I could see people easily surpassing that and then being pushed to, have to pay for it, which is a very different social media experience than I think most people have these days.
00:51:32.592 --> 00:51:35.143
and so I sort of wonder what impact that's gonna have.
00:51:35.213 --> 00:51:36.632
What, what was your take on this story?
00:51:37.105 --> 00:51:47.978
I think it's kind of an arbitrary line l- drawn to try to, you know, make a distinction between, regular users and commercial users maybe, and sort of like this is how we can make money.
00:51:48.380 --> 00:52:08.213
to me, it made me think about virality and kind of the benefits and dangers of virality for messages more generally and how, you know, other companies have tried to limit, especially when you don't know what the message is, try to limit virality so that, like, you don't have a message or a group that's basically fomenting mob violence or something like that.
00:52:08.554 --> 00:52:23.324
I think in either way, the company is just kinda trying to draw a line between, like, what is something people really should know and is a big enough group to have that important message get out versus something that's probably mob violence.
00:52:23.364 --> 00:52:23.923
You know?
00:52:24.204 --> 00:52:33.155
What is something that's, like, what a regular user's level of interactions on X is versus something that's spam or a commercial account that's taking advantage.
00:52:33.365 --> 00:52:36.356
And so it's just an example of how do we draw lines?
00:52:36.612 --> 00:52:44.001
Yeah, and it, it is fairly arbitrary and there's, you know, it's not entirely clear are they doing this just to try and get more people to sign up and pay?
00:52:44.001 --> 00:52:49.641
Is it a revenue generation play or is it a anti-spam tool or is it a combination of both?
00:52:49.641 --> 00:52:54.840
And then did they do any testing, investigations into whether or not this was the right levels?
00:52:55.170 --> 00:52:56.780
There are all of these choices that are made.
00:52:56.780 --> 00:53:04.831
I don't have much faith that there was much thought put into this just because I don't think X does things with particularly a great deal of thought.
00:53:05.108 --> 00:53:11.831
and it'll be interesting to see, if we start to see people bumping up against these limits and how they feel about it, as time goes on.
00:53:11.831 --> 00:53:21.485
But it's, it's interesting to see'cause we sort of consider social media generally historically to be this kind of thing that you can, do as much as you want, you know, for better or for worse.
00:53:22.434 --> 00:53:24.014
But, but now there are limits in place.
00:53:24.815 --> 00:53:30.315
Anyways, we are basically out of time, but Jennifer, thank you so much for jumping into the guest hosting seat.
00:53:30.364 --> 00:53:32.644
This was really fun, really interesting discussion.
00:53:32.715 --> 00:53:34.695
I hope that listeners really enjoyed it.
00:53:35.262 --> 00:53:35.902
I certainly
00:53:36.237 --> 00:53:36.657
I did.
00:53:36.657 --> 00:53:36.916
too.
00:53:36.976 --> 00:53:39.097
And, thank you everyone for listening as well.
00:53:39.788 --> 00:53:45.275
And, we'll be back next week and Ben will be back from his paternity leave, and we'll have lots of exciting news then.
00:53:45.306 --> 00:53:46.255
So thanks again.
00:53:46.498 --> 00:53:47.108
Thanks, Mike
00:53:49.762 --> 00:53:51.902
Thanks for listening to Ctrl-Alt-Speech.
00:53:52.012 --> 00:53:55.521
Subscribe now to get our weekly episodes as soon as they're released.
00:53:56.061 --> 00:54:02.851
If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.com.
00:54:03.052 --> 00:54:05.902
That's CT RL alt speech.com.