BẢN CHÉP ÂM THANH 🔗
00:00:02
Speaker 1: Bloomberg Audio Studios. Podcasts. Radio. News. Before we start, I want to let you know we talk about suicide and self-harm in this episode. Please take care while listening.
00:00:17
Speaker 2: Chase was a normal kid. He was an honors student. He was a football star. Loved hanging out with his friends.
00:00:26
Speaker 1: Chase Nazca was a 16-year-old boy who grew up on Long Island.
00:00:30
Speaker 2: He loved going to the gym. He loved weightlifting. He did his homework. He was just a normal kid, a kid who would connect with his friends on social media.
00:00:41
Speaker 1: Chase would go on TikTok and watch videos about weightlifting and basketball, motivational speeches, funny clips.
00:00:48
Speaker 2: That's the kind of stuff he was searching for. That's just not what the algorithm fed him.
00:00:54
Speaker 1: Chase also used the app to listen to songs about loneliness, hopelessness, And in the winter of 2022, his feed took a turn, serving him more and more content in that vein.
00:01:06
Speaker 2: This is video after video after video about depression, sadness, hopelessness, loneliness, self-harm and suicide.
00:01:17
Speaker 1: Chase's TikTok was stuck in a dark loop. The videos he shared with his friends got sadder. And in February of 2022, Chase died by suicide. His parents filed a wrongful death lawsuit against TikTok the next year. Bloomberg investigative reporter Olivia Carville wrote a story about Chase for Businessweek in 2023. In response to questions from Businessweek at the time, a TikTok spokesperson said that it didn't comment on pending litigation, but that the company was committed to the safety of its users, especially teens, and that it would continue their, quote, significant investment in safeguarding our platforms. For the past several years, across the U.S., thousands of suits have been filed against the world's biggest social media companies, alleging that the platforms have harmed the mental health of young people. These cases have been filed by school districts, families like the NASCA's, and by state attorneys general. And last week, on August 26th, one of the most consequential of these cases against Meta reached a historic settlement. Facebook has agreed to a landmark $ 17 billion settlement. trial over teen social media addiction and settled claims filed by 47 states. Olivia says the meta-settlement could mark a sea change for the social media industry and bring some of the accountability people like Chase's parents and many other families have been pushing for.
00:02:49
Speaker 2: They've been telling me they're screaming into the wind. No one's listening. They've been calling for Congress. to roll out laws. And we finally saw change through the justice system, which, you know, is remarkable. This litigation has been going on for half a decade. And August 26th was a huge moment for so many people.
00:03:13
Speaker 1: I'm Sarah Holder, and this is The Big Take from Bloomberg News. Today on the show, how did Chase Nazca's TikTok feed change so significantly? Bloomberg investigative reporter Olivia Carville on the consequences of a TikTok algorithmic experiment and how Meta's landmark settlement could spark broader changes for how social media platforms approach safety for young people. TikTok is famous for its powerful algorithm. It learns what videos users like to see and shows them more of them. And a few years ago, that algorithm was under a microscope.
00:03:56
Speaker 2: So back in the summer of 2021, the Wall Street Journal and other media outlets started investigating TikTok's algorithm because it was so mysterious. And what these reporters started to uncover is that users who were interested in things like healthy eating or excessive exercise or fitness started to get pushed out. content that was more and more extreme. So healthy eating turned to eating disordered content or posts about breakups or sadness over a relationship breakdown turns to self-harm videos.
00:04:30
Speaker 1: Some users were getting caught in something called a filter bubble, essentially an echo chamber of content that could be as benign as cat videos or much more harmful.
00:04:43
Speaker 2: And so the company was under scrutiny for these filter bubbles. In the summer of 21, by the end of that year, they announced they're going to start testing ways to break up repetitive streams of videos about harmful content like loneliness or extreme dieting.
00:04:58
Speaker 1: But this month, Olivia reported on a confidential internal document produced by TikTok back in 2023 that was turned over to lawyers as part of a legal case against the company and placed under a court-ordered seal. The document revealed that those changes to TikTok's algorithm did not go out to all users.
00:05:20
Speaker 2: As we know from what is contained in the confidential document, in early 2022, they made the call to roll out that safeguard to 90% of US users to ensure that they weren't going to be pushed into filter bubbles of harmful content. But they held back that control group. 15 million people did not get the safeguard. One of those people was Chase Nasker.
00:05:44
Speaker 1: Chase Nazca, the 16-year-old from Long Island.
00:05:47
Speaker 2: His account fell into that filter bubble of harmful content starting on January 25th, 2022. He was fed thousands of videos about depression, sadness, hopelessness, loneliness, self-harm, and suicide right up until his own death. On February 18th of 2022, Chase Nazca stepped in front of an oncoming train and took his own life. What we know now, looking back, is that days before he died, he did view a TikTok video of a young man standing on train tracks with the caption, went for a quick little walk to clear my head. So he viewed content about the method of suicide that he ended up taking his own life by.
00:06:34
Speaker 1: When Olivia first reported on Chase in 2023, TikTok had not disclosed anything publicly about the filter bubble
Load full transcript
test.
00:06:43
Speaker 2: So in 2023, I asked the company, why was this 16-year-old boy being served suicide content by your algorithm? What the company disclosed publicly for that Businessweek article was our hearts are with the family. This is a real tragedy. We do everything we can to protect young users on our platform. We have robust trust and safety detection teams. You know, we block harmful content or anything about suicide and self-harm. The story is what they didn't say.
00:07:15
Speaker 1: What Olivia recently learned is that behind the scenes at TikTok, her request for comment sparked an internal review, which culminated in an internal document that the company titled Bloomberg Businessweek Youth Safety and Filter Bubbles Escalation Summary.
00:07:32
Speaker 2: Individuals from TikTok's algorithm team, their trust and safety team, do a deep dive of Chase's watch history in the weeks, hours and days leading up to his death. They review more than 7,500 videos that Chase had watched. And what the company determined is that through a back test experiment, what they call an A-B experiment, which is relatively commonplace in the social media industry, what that internal review found is that this teenage boy's account was placed in an A-B experiment. He was randomly selected in January of 2022. Within a month of Chase Naska being placed in that AB experiment, he was dead. Wow.
00:08:19
Speaker 1: And what did TikTok say about why they were running such an experiment in that confidential document?
00:08:26
Speaker 2: So all I can say is what we've reported on thus far, which is that the company was running these experiments to test user engagement. There are two really important quotes that came from the confidential document we reported on. One, the company said TikTok's filter bubble prevention strategies did not take effect on this user by design.
00:08:51
Speaker 1: By design.
00:08:52
Speaker 2: By design. The second important quote in the document is TikTok essentially explaining why they ran that back test. Why was it important to conduct this experiment and hold back that control group from a safeguard? And they explained that the user impact decision was a delicate balance across safety and and the ability to measure impact on DAU and core metrics. DAU is daily active users. So the company wanted to know how the engagement levels of its user base would be impacted between the 90% of users who had the safer version of the algorithm and the 10% that did not. 10% of TikTok's user base was 15 million people.
00:09:40
Speaker 1: What has TikTok said in response to your latest reporting on this confidential document?
00:09:45
Speaker 2: So the latest statement from TikTok was very similar to what we got in 2023 when we wrote that story about Chase Naska, kind of echoed it almost word for word. What TikTok said in response was that their hearts go out to any family that experienced a tragedy like this. And they also talked about how they're
doing everything they can to prioritize child safety on the platform. They talked about how they have robust detection systems to try and flag this kind of content and that they're working at safeguarding the platform, making it safer for kids. And don't forget that, you know, TikTok had more than 40,000 people working on its trust and safety team, trying to ensure that its platform is safe and trying to ensure that kids aren't seeing this kind of content. They don't want teenagers seeing nonstop videos about suicide. That doesn't help them in any way. And that's important to remember, too. They've invested more than a billion dollars in trust and safety over the years, and they continue to do so. It's just that because the companies are so prioritized to focus on engagement, to focus on profit, to focus on being competitive in this hyper-competitive industry where they're all vying to get the next user, they all want to be the coolest product. So teenagers flock to them. If they have the teen market, you know, they're deemed to be cool. And that means that teens are going to use them and want to keep using them.
00:11:10
Speaker 1: Olivia, the intersection of social media, teens and mental health has been a major reporting focus of yours, as you said. Since you started covering the subject, have there been any significant changes to how these platforms approach keeping young people safe on their platforms?
00:11:25
Speaker 2: I've been reporting on the dangers of the digital world for children and for teenagers for years now. And over those years, we have seen the conversation shift. It has shifted from, could social media harm the mental health of young people, to the this is a full-blown public health crisis. Our children are in need of help and we have to block, change, regulate these companies. Over the course of that time, the platforms have made changes to try and make their products safer, to add guardrails. But as we've seen in documents that have come out through litigation, a lot of the safeguards that they're adopting just aren't very effective. And oftentimes they will publicly tout like, hey, there's this cool new feature and look how it's going to protect teens from X, Y and Z. And then you ask the question of how many people are using it and it's less than 1%. What we've seen from the industry is repeated claims of making the product safer when the reality is it hasn't actually been protecting young people. But that all changed on August 26th.
00:12:40
Speaker 1: After the break, what changed on August 26th, and how the outcome of a landmark case could change the social media platforms we use every day. On August 26th, Meta, the parent company of Facebook and Instagram, came to a landmark settlement to resolve claims from U.S. states that alleged the company used deceptive advertising and designed its platforms to get children hooked. As part of the settlement, Meta agreed to pay up to $ 17. 1 billion and made several changes to its platforms in the U.S., including safeguards aimed at protecting teen users.
00:13:31
Speaker 2: Things like blocking children from being able to access Instagram and Facebook from the hours of midnight to 6 a.m., putting a two-hour limit on teenage scrolling on Facebook and Instagram so kids can only scroll the platforms for two hours a day, increasing parental control safeguards. And what we saw from Meta on August 26 was a call-out to the rest of the industry saying, join us in protecting teenagers, directly asking YouTube and TikTok to to make those same product changes to ensure teenagers are safe because it's not going to work unless they all do it. And so part of the settlement is actually $ 5 billion is contingent on other platforms joining Meta and rolling out those same safeguards. Meta is paying $ 12 billion. It is paying an additional $ 5 billion only if those companies follow suit and introduce the same framework.
00:14:23
Speaker 1: So this is Meta's condition?
00:14:25
Speaker 2: That's right. That's right. They'll say, we'll give you an additional $ 5 billion if... you can ensure that those other companies roll out the same framework because they're afraid of their market share. If we lock out teens for six hours in the night, they're just going to shift to Snapchat, which doesn't help anybody. So let's make every social media platform play in the same rules, play the same game.
00:14:47
Speaker 1: So Olivia, I want to pause on this for a second because this is extremely significant in this space. Meta has to pay this huge financial penalty and it's rolling out these platform-wide changes that lawmakers and victims have been asking for for years what do you think the effect of those kinds of changes is actually going to be and and do you think other social media platforms will follow meta will heed that call to action.
00:15:15
Speaker 2: 17 billion sounds like a massive number and it is don't get me wrong but meta is one of the wealthiest companies in the world The last quarter, its revenue was $ 60 billion. So I think a lot of people have pointed out that really the financial penalty probably isn't enough to make the company do anything different. But really, the change lies in those product updates. That's the significant thing here. That's where the accountability is. And I do think we are going to see other platforms roll out additional safeguards to protect teenagers. And I think the conversation is shifting and And the winds of change are coming. Meta is now rolling out changes that these families have been calling for for years.
00:16:01
Speaker 1: This August 26 settlement that Meta made comes as thousands of personal injury lawsuits have been filed against social media companies. 4,000 over the past four years. As more of these cases get litigated, what new information is coming out about how these platforms work? And do you think that this meta-settlement will have a bearing on how these other cases play out?
00:16:27
Speaker 2: We have seen over the past five years thousands of lawsuits filed across the U.S., not only personal injury cases, and those are cases that are filed by individuals or families of kids who have tragically died, like Chase Naska's parents. There are more than 1,300 school districts across America that have filed lawsuits against these companies alleging mental health harm and that have drained school resources. Dozens of state attorneys general have filed the same lawsuits against those companies. So this is a massive, consolidated litigation, nationwide litigation, that has been compared to big tobacco. Compared to the opioid litigation, you know, some of the most significant mass tort litigations in American history. We still have thousands of other lawsuits to go. The story is not over. Really, it's just begun.
00:17:17
Speaker 1: In response to your latest reporting on TikTok, on this confidential document, on the A-B testing that was done, senators sent a letter saying, to TikTok leadership demanding answers to some of their questions. I'm wondering if you could just talk about the lawmakers' response to your reporting about the existence of this experiment and what they want from TikTok.
00:17:42
Speaker 2: Senators Marsha Blackburn and Richard Blumenthal have been advocates of a safer digital world for kids for years. They are co-authors of the Kids Online Safety Act, which passed in the Senate in 2024 but died in the House that year. And after the story came out, they wrote a letter to TikTok CEO Xiao Chu and TikTok CEO of its US spinoff. Essentially asking the company direct questions about this experiment. How many other kids have been experimented on like this? How many other users were impacted? What other algorithmic experiments has TikTok conducted over the years? Asking specifically, who knew about this experiment? What are the names and titles of the employees? Did leadership know about this experiment? When did leadership become aware of this experiment? And they also asked for an unredacted document. They wanted to see the confidential document that the story was based on to understand more about what had happened. Those 13 questions were sent to the company shortly after the story was published, and they gave TikTok a deadline of September 1 to respond.
00:18:53
Speaker 1: In that confidential document, TikTok also included its own recommendations. to, quote, prevent future incidents. What were those recommendations? And do you have any knowledge of whether or not the company has implemented any of those recommendations?
00:19:09
Speaker 2: So what we know from the information that was contained in the confidential document is that the company decided after that review was conducted and they realized what had happened to Chase NASCA's account, they decided to reduce the size of the control group from 10% of American users to down to 1%. 1% is still 1.5 million people, but it's a hell of a lot better than 15 million. They also decided to reduce the length of time those users would be exposed to filter bubbles. So they went from half a year to a year that users were being exposed in the control group to seven days. And that's significant.
00:19:51
Speaker 1: I want to end by talking about enforcement. Is there energy around broader federal intervention to change the way these kinds of platforms operate and the kinds of guardrails that exist to protect teens on these platforms?
00:20:07
Speaker 2: In order to get federal laws, we need legislators to work together. I mean, we're just in a deadlock. The Senate has their own version of a child safety bill called the Kids Online Safety Act that they are championing and that they want to get passed. The House has its own child safety bill called the Kids Internet Digital Safety Act, the Kids Act, that it wants to pass. And they're in disagreement over which bill should actually land on Trump's desk. So until we get some kind of agreement within lawmakers, we're never going to see the laws change. We're never going to see any kind of federal regulation. And I think that's why so many child safety advocates and so many families turn to the courts for accountability. And that is what we have recently seen. It's all still in flux right now. It was only just recently announced. But there is going to be an independent auditor who has to ensure that the platforms are rolling out the safeguards that they're claiming that they've rolled out. Who knows if we'll see TikTok, YouTube, Snapchat and other companies join Meta in making these changes.
00:21:12
Speaker 1: As for the wrongful death lawsuit that Chase Nazca's parents filed against TikTok, it was dismissed by a judge last year after TikTok argued it was protected from liability under Section 230. An appeal of the case is pending.
00:21:27
Speaker 2: Personally, as a journalist, as a young mum, I hope that we make the internet a safer place for kids because it has just been the Wild West up until now. We have run a giant experiment, a psychological experiment, on an entire generation of children for a for-profit industry. And I don't use that word experiment lightly. That's how TikTok described what it did. It was an A-B experiment. We are literally experimenting on the minds of children without understanding the long-term impacts and consequences of how that is going to play out. Like I think five years from now, if we look back and think, do we really let 11, 12, 13-year-olds sit in their rooms at night with a phone? You know, you give your kids this device and you give them access to everything, the entire world, but you give the world access to them as well.
00:22:25
Speaker 1: If you or someone you know is having thoughts of suicide or self-harm, a global list of helplines is available at blog.opencounseling.com slash suicide dash hotlines. This is The Big Take from Bloomberg News. I'm Sarah Holder. To get more from The Big Take and unlimited access to all of Bloomberg.com, Subscribe today at Bloomberg.com slash podcast offer. If you liked this episode, make sure to follow and review The Big Take wherever you listen to podcasts. It helps people find the show. Thanks for listening. We'll be back tomorrow.