#145 — The Information War

Episode Summary

Executive Summary: Renee DiResta explains how online manipulation evolved from anti-vaccine activism and ISIS propaganda monitoring into a clearer understanding of Russian disinformation in 2016. She argues that social platforms, recommendation algorithms, and concentrated audiences enabled a small, sophisticated IRA operation to build fake communities, amplify tribal conflict, and exploit real grievances—especially in Black, conservative, and other polarized audiences.

Main Topics: Origins of DiResta’s disinformation research (Priority: 5/5): She traces her path from vaccine-policy activism and observing online manipulation around California’s vaccine bill to studying ISIS and eventually Russian interference, showing that the tactics were similar across causes and actors. Platform responsibility and moderation failures (Priority: 5/5): DiResta contrasts Facebook, YouTube, and Twitter’s early responses to extremist content, arguing that platforms initially prioritized free-speech concerns and growth over meaningful moderation, then swung toward imperfect, sometimes overzealous enforcement. Why social media amplifies manipulation (Priority: 5/5): She identifies three structural drivers: audience consolidation onto a few platforms, precision targeting enabled by ad-tech surveillance, and recommendation algorithms optimized for engagement rather than harm reduction. The Internet Research Agency’s strategy (Priority: 5/5): The IRA is presented as a long-term social-media influence operation that built fake personas, pages, and communities to grow tribes and intensify division, rather than merely posting random memes or isolated political messages. Targeting identity and grievance communities (Priority: 4/5): DiResta describes how IRA pages focused on Black audiences, Confederate/texas pride, Muslims, LGBT issues, gun rights, and other identity groups, often pairing genuine pride or grievance with divisive political content. Scale and effectiveness of the operation (Priority: 4/5): Although many pages failed, a subset gained substantial followings and engagement; successful accounts cross-promoted one another to create an interconnected ecosystem that could nudge users deeper into polarized content.

Key Arguments: Russian interference in 2016 is not seriously in doubt; it is supported by intelligence agencies, researchers, platforms, and indictments. The IRA’s campaign was not just ad hoc trolling—it was a deliberate, long-game effort to build trust and grow distinct American tribes online. Social platforms enabled manipulation because a few actors could dominate hashtags, exploit engagement incentives, and use recommendation systems to surface conspiratorial content. Platform moderation was initially shaped by fear of being seen as censorious, leaving harmful content in place; later overcorrection created new failures and accusations of bias. Recommendation engines are more culpable than passive hosting because they actively suggest content, steering users into adjacent conspiracies without obvious intent. The black community was a major focus because identity-based pride, grievance, and alienation could be exploited especially effectively through targeted pages and content. The same manipulation toolkit—automation, fake personas, secret groups, narrative ownership—appeared in anti-vax activism, ISIS recruitment, and Russian influence operations, indicating a reusable social-media playbook.

Data Points: Facebook pages: 81 - Number of IRA Facebook pages in the dataset Instagram accounts: 133 - Number of IRA Instagram accounts in the dataset Facebook posts: 62,000 - Approximate total posts across the Facebook pages Instagram posts: 116,000 - Approximate total posts across the Instagram accounts Instagram engagements: 187 million - Total engagements on Instagram content Facebook engagements: 75 million - Total engagements on Facebook content Black-focused Facebook pages: 30 of 81 - Share of Facebook pages focused on the Black community District polling on California vaccine bill: about 85% positive - Legislators saw broad district support for removing personal belief vaccine exemptions Social media sentiment on vaccine bill: about 99% negative - Online conversation was overwhelmingly opposed despite favorable polling Mutual friends with Tristan Harris: about 60 - DiResta and Harris discovered many shared connections before meeting Timeframe of IRA pivot to U.S.: around 2015 - Project Lakta marked the shift from Russian/Ukrainian propaganda to U.S.-focused influence

Pivotal Quotes: "these are beheading videos, you guys. These are terrorist recruiters. These are people who are killing people. What the hell is this conversation?" — Renee DiResta: Her reaction to early 2015 debates over whether Twitter should remove ISIS content "what they were trying to do was grow tribes" — Renee DiResta: Her description of the IRA’s strategic aim beyond simple meme-spreading "This is not a partisan issue. This is not a one, you know, one state, you know, one foreign actor interfering in one moment issue." — Renee DiResta: Her framing of Russian interference as a broader ongoing global challenge

Implications: Listeners should see disinformation as an ecosystem problem: platform design, targeting, and recommendation systems reward division. The industry faces pressure to moderate more responsibly without turning moderation into arbitrary censorship.