Sean Carroll MindScape
Sean Carroll MindScape

330 | Petter Törnberg on the Dynamics of (Mis)Information

A characteristic of complex systems is that individual components combine to exhibit large-scale emergent behavior even when the components were not specifically designed for any particular purpose within the collective. Sometimes those individual components are us -- people interacting within socie

Featured Speakers

Sean Carroll | Wondery HostPetter Tornberg Guest

Topics Discussed

Episode Summary

Executive Summary: Sean Carroll and Petter Tornberg explore how physics-style complexity science can illuminate social systems without reducing them to physics. The conversation centers on social media, segregation, echo chambers, and misinformation: simple interaction rules can generate strong polarization, attention inequality, and community formation even without overt top-down control. Tornberg also discusses LLM-based agent simulations as a new tool for studying platform dynamics and their limits.

Main Topics: Physics envy and complexity in social science (Priority: 5/5): Carroll opens by contrasting physics’ simplifications with the messiness of social systems, while Tornberg argues complexity science can still reveal robust macro-patterns in society when used carefully. Power, epistemology, and the shift from Fordism to platforms (Priority: 5/5): Tornberg explains that society moved from a machine metaphor rooted in industrial modernity to a complex-systems metaphor shaped by platforms, networks, and hidden forms of power. Schelling segregation and emergent polarization (Priority: 5/5): They revisit Schelling’s classic segregation model and Tornberg’s online generalization, showing how local preferences can cascade into near-complete segregation in digital communities. Echo chambers, attention inequality, and the social media prism (Priority: 5/5): Tornberg’s LLM-based platform simulation reproduces three platform pathologies: partisan clustering, power-law attention concentration, and preferential amplification of extreme voices. Limits and promise of LLM-based agent simulation (Priority: 4/5): The guest describes using personas derived from survey data to create more realistic agents, while stressing that LLM simulations are hard to validate and should be interpreted through robust structural outcomes, not exact text generation. Misinformation, politics, and platform incentives (Priority: 4/5): The discussion links social media to misinformation as a strategic political behavior, especially among radical-right populist parties, and emphasizes that platform incentives can reward outrage over truth. Potential interventions and why simple fixes fail (Priority: 4/5): Tornberg reviews interventions such as chronological feeds, hiding bios, and bridging tools, but says these do not reliably solve the structural problems and can even worsen them.

Key Arguments: Social science should not imitate physics blindly, but physics-like reasoning is useful when it highlights emergence, equilibrium, and collective behavior. The move from industrial society to platform society changed not just technology but the epistemology of power: control is now embedded in interaction rules and algorithms rather than only top-down institutions. Schelling-style local preference rules can generate strong segregation even when individuals are relatively tolerant, showing that small thresholds can create large-scale instability. Digital communities may segregate even without filter bubbles; platform structure and interaction dynamics alone can produce echo chambers. Filtering algorithms can paradoxically reduce some forms of segregation in the model because they keep users from encountering disconfirming content that would trigger departure. LLM-based agent simulations can reproduce real platform-level pathologies with only a bare-bones platform and diverse personas, suggesting these outcomes are structurally robust. Attention on social platforms follows power-law distributions, with a few accounts dominating discourse; this is a structural property of networked media, not necessarily a flaw of individual content alone. Misinformation is not merely a content problem; it becomes politically useful when social-media incentives align with radical political competition, especially on the right. Simple design tweaks are unlikely to fix social media because the core problem lies in the interaction of platform architecture, incentives, and human behavior. Social media has genuine benefits for marginalized groups and global connection, so the goal is not abolition but redesign toward healthier forms of interaction.

Data Points: Schelling model year: 1969 - Sean Carroll notes the original segregation model’s publication date. LLM social network size: 500 users - Tornberg says the simulated social media platform was run with 500 users. Users in Stormfront study: 20+ year period - The archive used for the hate-community analysis spans more than two decades of conversations. Election surge in Stormfront: few days after the 2008 Obama election - Tornberg describes a large influx of new users and emotional responses after the election. Social media / mainstream media shift: around 2010 - A student project found a jump in clickbait-style New York Times headlines after social media’s rise. Political data source: American National Election Survey (ANES) - Used to build personas for the LLM agents, including politics and lifestyle details. Platform outcomes observed: 3 - The LLM simulation produced three main problems: echo chambers, attention inequality, and the social media prism.

Pivotal Quotes: "power has an epistemology" — Petter Tornberg: Introduced as a framing idea for how power operates differently in industrial versus platform society. "if you have a filtering algorithm that always shows you someone who agrees with you ... you will become less prone to move" — Petter Tornberg: Explaining why certain filters can reduce segregation in the model by lowering the trigger to leave communities. "what we take from this is that this basic structure that we see across social media platforms where you have a network ... tends to be linked to these problematic outcomes" — Petter Tornberg: Summarizing the paper’s conclusion about structural causes of platform harms.

Implications: The conversation suggests that social media harms are structural, not just algorithmic or individual, so superficial fixes are unlikely to work. Better platforms will require redesigning incentives, interaction rules, and information flow rather than only tweaking feeds.

🔓 Sign Up for Unlimited Episode Search

About Sean Carroll MindScape

Ever wanted to know how music affects your brain, what quantum mechanics really is, or how black holes work? Do you wonder why you get emotional each time you see a certain movie, or how on earth video games are designed? Then you’ve come to the right place. Each week, Sean Carroll will host conversations with some of the most interesting thinkers in the world. From neuroscientists and engineers to authors and television producers, Sean and his guests talk about the biggest ideas in science, ...

View all episodes from Sean Carroll MindScape