Deepfake Abuse is a Crisis w/ Kat Tenbarge

Episode Summary

Executive Summary: Paris Marks and NBC reporter Kat Tenbarge examine the rise of AI-generated sexual deepfakes, especially after Taylor Swift images went viral, showing how platforms, search engines, and AI vendors enable harm while failing victims. The discussion compares deepfakes to revenge porn, highlights their global spread into schools and everyday life, and calls for stronger regulation, accountability, and survivor-led activism.

Main Topics: Taylor Swift deepfake scandal as a turning point (Priority: 5/5): The January viral spread of explicit AI-generated Taylor Swift images on X exposed both the scale of the problem and the inability or unwillingness of platforms to remove harmful content quickly. How deepfake communities and platforms enable abuse (Priority: 5/5): Tenbarge explains that deepfake creation is rooted in male-dominated online communities and profit-driven websites, with platforms and moderation systems often failing to intervene effectively. From celebrity harm to everyday victims (Priority: 5/5): The conversation emphasizes that while celebrities draw attention, the greatest harm is increasingly falling on ordinary women, teens, and school communities, including middle and high school students. AI tools, open-source ecosystems, and easy access (Priority: 5/5): The guests discuss how consumer-facing apps, open-source code, and major tech companies’ tools have made it much easier for non-experts to create explicit fake images at scale. Search engines and payment processors as enablers (Priority: 4/5): Google and other search systems direct users toward deepfake sites, while payment networks and crypto tools help monetize them, creating a broader infrastructure of complicity. Legal, educational, and cultural responses (Priority: 4/5): The episode reviews patchwork state laws, stronger European and Australian approaches, school-level interventions, and the role of activism, while noting enforcement and jurisdiction remain weak. Psychological and social consequences (Priority: 5/5): Deepfakes are framed as a form of sexual abuse that can trigger trauma, self-harm, withdrawal from public life, and renewed gender discrimination in male-dominated fields.

Key Arguments: Deepfakes are not harmless or merely 'fake'; they cause real psychological harm because people process images as if they are real. Platforms like X and mainstream companies have been reluctant to remove deepfakes quickly or suspend repeat offenders, leaving victims to rely on mass reporting or public pressure. The problem has moved from underground niche communities to mainstream, consumer-accessible apps, dramatically expanding who can create abuse. Celebrities matter because their visibility forces attention, but ordinary women and girls are the primary victims and often lack any path to recourse. Deepfake abuse is an extension of the revenge porn crisis, but with a far greater scale because perpetrators no longer need real intimate images. Google search results can funnel people toward deepfake pornography, making search engines part of the distribution problem, not just neutral intermediaries. Tech companies routinely release AI tools first and address harms later, which Tenbarge argues is a dangerous business model that prioritizes hype and profit over safety. Regulation alone is insufficient without cultural change, school interventions, platform enforcement, and survivor support. Anti-feminist online culture and male peer bonding help normalize creation and sharing of these images, especially among school-aged boys. Victims often need resources, lawyers, and technical expertise that most people do not have, so formal legal remedies do not reach most harmed individuals.

Data Points: Time since podcast launch: 4 years - Paris Marks notes the show is celebrating its fourth birthday. Episodes produced: Over 200 - Marks references the show’s output over four years. Show transcripts available: More than 90 - Marks says transcripts are available on the website. Taylor Swift image views: Over 40 million - The viral deepfake image had been viewed this many times before removal. Deepfakes created in 2023: More than every other year combined thus far - Tenbarge describes 2023 as a watershed year for deepfake creation. Documented high-school/middle-school cases: At least a dozen - Tenbarge says cases in schools are already numerous, likely undercounted. Age context for Miley Cyrus example: At the oldest, 15 - A search result showed a Miley Cyrus image from before age 18 used in deepfake search results. Supporters goal: 200 new supporters - Marks promotes a Patreon goal to fund a new AI-hype investigative series. Patreon minimum support: $5 per month - Listeners are asked to support the show starting at this amount.

Pivotal Quotes: "You made this technology. You did not think about this. Or if you did, you did not create guardrails around these obvious problems. And now people are suffering as a result." — Paris Marks: Opening framing for the episode’s central accountability argument. "We cannot function in a society where we're going to let the harm happen first, and then we're going to respond to it." — Kat Tenbarge: On how tech companies launch AI products without adequate safeguards. "This is your fault. You made this technology. You did not think about this. Or if you did, you did not create guardrails around these obvious problems." — Kat Tenbarge: A direct indictment of tech companies’ responsibility for deepfake abuse.

Implications: The episode argues that deepfake abuse is already a mass harm requiring urgent regulation, platform enforcement, and cultural pushback. Without action, AI-enabled sexual abuse will keep expanding from celebrities to schools and workplaces, normalizing gendered violence.