15 million Americans were excluded from TikTok's new safety features in an A/B test. A 16-year-old, Chase Nasca, watched 7,563 harmful videos before killing himself. TikTok's internal report revealed 10% of users received content promoting suicide or self-harm, violating guidelines. The test ran for up to a year, with TikTok later denying responsibility. The Surgeon General had warned platforms about teen mental health risks, and Facebook abandoned pre-teen Instagram plans. TikTok's CEO, Shou Chew, faced congressional scrutiny but downplayed links between the platform and suicides. An internal Bloomberg report urged reducing the test group to 1% of users. TikTok claims it has refined testing but provided no details. The case highlights risks of algorithmic content curation and regulatory gaps for social media safety.

TikTok's experiment involved deliberately withholding safety tools from 15 million users to assess effectiveness. Chase Nasca's case became a tragic outcome, as his algorithm recommended suicide-related content despite platform rules. The internal report, sealed by courts, suggested expanding safety tests to fewer users and shorter durations. TikTok's spokesperson emphasized commitment to safety but faced criticism for denying evidence. The Surgeon General's 2023 warnings about social media's impact on youth mental health contextualized the incident. Other platforms, including Facebook, faced similar scrutiny, leading to policy changes. TikTok's actions raise questions about corporate accountability and algorithmic harm.

The internal investigation, prompted by Businessweek, revealed systemic issues in TikTok's safety protocols. Despite Chase Nasca's death, the company maintained its stance, citing Section 230 protections. The report's recommendations were not implemented, and Shou Chew remains CEO. The case underscores the ethical dilemmas of using real users in safety testing. Millions may have been exposed to harmful content during the experiment, with long-term mental health impacts unmeasured. TikTok's refusal to share detailed test results or address Congress' queries further damaged trust. The incident has fueled calls for stricter regulations on social media platforms handling minors.

TikTok's defense centers on its "Trust & Safety" investments, but critics argue the A/B test prioritized data over welfare. The 10% exclusion rate and 7,563 videos viewed by Chase Nasca illustrate the experiment's scale. While TikTok claims improved testing post-incident, transparency remains lacking. The case has become a focal point in debates about algorithmic accountability and youth protection. Legal challenges and public pressure may force the company to reconsider its approach. The 15 million affected users and Chase Nasca's death serve as stark reminders of technology's potential risks when safety is treated as an experiment.