РАСШИФРОВКА 🔗
00:00:02
Speaker 1: Bloomberg Audio Studios, Podcasts, Radio News.
00:00:08
Speaker 2: You're listening to Bloomberg Business Week with Carol Masser and tim Stenoveek on Bloomberg Radio.
00:00:14
Speaker 1: So we do want to get to a Bloomberg Business Week exclusive original reporting. It's on a story about a confidential document that says kept a safety feature from millions of TikTok users, about fifteen million by design as part of an experiment. One of those users died by suicide. There is a lot of careful reporting here to get to the story by the award winning and recognize Bloomberg News investigative reporter Olivia Carvill. She joins us here on set. The story, by the way, is also Today's Bloomberg Big Take, Olivia. Good to have you hear. This story is about a document. What is this document? What does it tell us?
00:00:52
Speaker 3: Thank you so much for having me on. So I think it's important to have context around this document, and for that we've got to go back in time. Early Truthy twenty two, a sixteen year old boy from Long Island took his own life. He died by suicide. After this happened, his mum, who didn't understand when searching through his social media accounts, trying to find a sense of what had happened to him. When she found his TikTok account, she was shocked by the fact that the algorithm was sending him non stop distressing, depressing videos, many of them encouraging suicide. A year later, I reach out to the company because I'm writing a story about this young boy and the way the algorithm was sending in so much sad content, and I asked the company what had happened to Chase NASCAR's account? Why is the algorithm sending him all of these videos about suicide? That sparked an internal review at TikTok. It's an extraordinary review where they do a deep dive into his watch history, what he was seeing in the weeks, days, and hours before he died. And that review is what is contained within this confidential talk document.
00:02:01
Speaker 2: Tell us more about Chase.
00:02:03
Speaker 3: Who is he? Chase was a sixteen year old boy from Long Island. He was a high school junior, an elite athlete, really good at swimming, really good at soccer. He had a big group of friends. He had no mental health issues. There was no depression, no anxiety in his background. He was an honors student, there was no warning shots that there was a concern with his own mental health. His death was a mystery to his friends, to his family. But what happened in January of twenty twenty two is that this young teenage boy started sharing very dark videos on TikTok with his friends, videos about suicide. They didn't understand why he was sharing this content, and it happened very quickly. And this document tells us why.
00:02:51
Speaker 1: What does it tell us?
00:02:52
Speaker 3: It tells us that this teenage boy's account, this very normal teenage boy, was pushed into a filter bubble of suicide and self harm content. That's like an online echo chamber where he is repetatively recommended depressing sad videos, many of them encouraging suicide. And it tells us why he was pushed into that filter bubble.
00:03:16
Speaker 1: So let's go there. Why was he pushed into this so called filter bubble?
00:03:21
Speaker 3: So again, if we go back in time in early twenty twenty two, TikTok has realized that these filter bubbles can be quite harmful for its users, and at this point, TikTok is one hundred and fifty million American users. They want to make the platform safer, so they design a feature to break up repetitive videos about the same topic. So rather than getting sad video, sad video, sad video, you get sad video, funny video, happy video, silly video. They want to break up those filter bubbles, so they roll out this feature, which they call a filter bubble prevention strategy, but they hold back ten percent of US users. That's one of the most important figures in this document. They withhold fifteen million Americans from this safeguard because they want to test engagement. They want to understand how this safety feature is going to impact how long you stay logged on for.
00:04:15
Speaker 1: So this group that they held back who didn't get essentially the safety future, right, that was their control group. That was their control So this was an experiment.
00:04:24
Speaker 3: This was an experiment in their own words in this document they refer to it as an experiment, and Chase Neske was in that control group.
00:04:35
Speaker 2: The go ahead, Carol, Well, one.
00:04:37
Speaker 1: Thing I want to ask, because you and I've talked about this story and I've read it and we've read it. When they held it back in the document, TikTok says they held it back. They held back the safety future by design. Why are those two words important.
00:04:52
Speaker 3: Those two words are so important, Carol, because right now in US courts, there is a broad litigation ledging that social media platforms are dangerous and addictive by design, that these companies have created platforms that it engineered for addiction, that what their main goal is is to keep you logged on for as long as possible, regardless of how that may impact your mental health. And so for the first time, we're seeing a social media platform use that same language that they experimented on millions of US users, including teenagers, and that as part of that experiment, they withheld a safety feature from one of those teenage users. Quote by design, This was the company intentionally deliberately holding back that safeguard.
00:05:44
Speaker 1: It speaks to there is an awareness, right, that's right.
00:05:47
Speaker 3: It speaks to intent.
00:05:49
Speaker 2: I want to read the company's response that they sent in you in response to questions about the document. A TikTok spokesperson center written statement saying the company was quote deeply committed to the safety and wealth being of users, especially teams. Our hearts break for any family
Load full transcript
that experienced a tragic loss, the spokesperson said, quote to help protect our community, we continue to invest significantly in trust and safety, including robust detection systems and dedicated enforcement teams that proactively remove content that violates our community guidelines.
00:06:18
Speaker 1: So, Olivia, that was the company's response in the last couple of weeks.
00:06:22
Speaker 3: That was the company's response this week to this story. And it's important to point out TikTok has forty thousand people working on their trust and safety team. They have huge investments, forty thousand people working on trust and safety. More than a billion dollars is spent trying to safeguard this platform. So there are huge efforts underway to do this. But I also think what this document shows us is that sometimes these decisions are made too fast without thinking about the impact on the user.
00:06:52
Speaker 2: Can you talk about this and you answered this a little bit before we read the statement, but the broader trend of social media companies over the last couple of years, I mean, you and the team did a great documentary on this about the pressure that they've come under, not just from lawmakers, but also from lawsuits that have been filed on behalf of families.
00:07:13
Speaker 3: Yeah, and I was mentioning the litigation earlier, So this is thousands of lawsuits that have been filed right across the country.
00:07:21
Speaker 1: Can I just put a number, because then you put a number on it, you said. More than four thousand personal andury lawsuits have been filed accusing social media companies of harming children's mental health. Many, though rate have been consolidated.
00:07:33
Speaker 3: YEAP been consolidated into two tracks, one in state court one in federal court. In addition to those four thousand lawsuits, twelve hundred school districts have filed the same case against the social media platforms, alleging that they are addictive and that they have drained school resources on like mental health counseling. And in addition to that, we're seeing forty two state attorneys general file suit against the companies alleging the same thing. So there is massive litigation unfolding across the US right now. We saw the very first trial earlier this year where Google and Meta were held accountable for harming the mental health of a twenty year old woman, and documents like this are surfacing right now because of that litigation. These companies went through a two year discovery process and they handed over more than six million internal documents to the lawyers. So now we get a first kind of behind the scenes look at what was really happening inside the world's biggest social media platforms as they fought to grow their users. And this is an incredibly competitive space. You know, the main goal is to keep you logged on for as long as possible, and they don't want to lose users to other platforms, and so this is part of that.
00:08:47
Speaker 1:
I mean, that's the thing, right, It's about bringing more users and then also set like kind of managing against safety, like managing those two things.
00:08:57
Speaker 3: And what it's called in the trust and safety space, Carol, is it's a trade off, a trade off between user safety and user growth. How do we keep the platform growing as fast as it can but keep it as safe as it can be for the users. And too often the companies, according to these lawsuits and according to previous reporting, are dialing up the user growth priority and dialing back the user safety priority.
00:09:23
Speaker 1: It's so important in this story and I highly recommend people check it out also on the Bloomberg But you can tell in the reporting you're very careful about laying out the timeline. I just want to go back to that for a moment, because there was a congressional hearing back in March on March twenty third, twenty twenty three, with TikTok's CEO answering questions from lawmakers. Is that that's an important moment in time.
00:09:44
Speaker 3: Too hugely important for this timeline. So if we think about what's happening now that we have this document, we know that inside the company they were doing this review of Chase Nesker's account to try and understand what had happened to his account and why he was receiving so many videos about suicide. They figure out why, and that's because he had that safeguard withheld from his account. And that same month, that very same month, the CEO is testifying before Congress answering questions about child safety. And I do want to point to just one of the follow up questions that they got from Congress. They were asked, specifically, how many cases is TikTok aware of where users have committed suicide after receiving sad, depressing or suicide promoting videos. We know the company knew that it had sent those kind of videos to Chase Nascar because of this document, and this was the written response. TikTok does not believe that use of the platform has caused users to commit suicide.
00:10:47
Speaker 1: And again, what's key is timing in all of this, which you lay out. As he testified two weeks after that in depth review, he said, TikTok dead of Chase's account.
00:10:56
Speaker 3: That's right that this was in the written responses to Congress that came from the company rather than from TikTok CEO. We're not aware of whether or not he was made aware of this review, but the company responded to congressional questions and put on the record that they didn't believe that their platform had caused any users to commit suicide. And this was said after this review was conducted.
00:11:18
Speaker 1: As we said, laid out, and the dates and the timeline are so important, as well as some of the words that were said. Thank you so much. We really appreciate it always. Bloomberg News investigative reporter Olivia Carville her full reporting. It is Today's Bloomberg Big Take. It is on the Bloomberg. It can also be found at Bloomberg dot com.