80,000 Hours Podcast
80,000 Hours Podcast

#146 – Robert Long on why large language models like GPT (probably) aren't conscious

By now, you’ve probably seen the extremely unsettling conversations Bing’s chatbot has been having. In one exchange, the chatbot told a user: "I have a subjective experience of being conscious, aware, and alive, but I cannot share it with anyone else." (It then apparently had a complete ex

Featured Speakers

The 80,000 Hours team HostRob Long Guest

Topics Discussed

Episode Summary

Executive Summary: Louisa Rodriguez interviews philosopher Rob Long about whether AI systems could be conscious or sentient, how we might tell, and why it matters morally. They survey theories of consciousness (especially global workspace and functionalism), discuss why current LLMs are unlikely to be sentient, and examine risks of accidental suffering, false beliefs about AI consciousness, and future digital minds that may differ radically from humans in capacity for pain and pleasure.

Main Topics: What AI sentience/consciousness means: The conversation defines phenomenal consciousness as subjective experience and sentience as positive or negative experience such as pain or pleasure, then asks what it would mean for a non-biological system to have these properties. Why artificial consciousness might be possible: Rob explains the functionalist/computational case: if consciousness depends on information processing rather than biological substrate, then silicon-based systems could in principle be conscious. How to detect consciousness in AI: The interview emphasizes using theories of consciousness—especially global workspace theory, computational neuroscience, and interpretability—to look for relevant internal mechanisms rather than relying on surface behavior. Moral risk: suffering, pleasure, and welfare: They explore the possibility of AI suffering at scale, the asymmetry between pain and pleasure in biological systems, and the moral significance of digital minds if they can feel. Current large language models and the Lambda case: Rob argues current LLMs are very unlikely to be sentient, and that cases like Lambda mainly show how easily humans can be misled by conversational behavior and suggestible outputs. Edge cases: copies, merges, and digital population ethics: They discuss the weirdness of copying, merging, and scaling digital minds, including political rights, resource allocation, and whether many copies create many morally relevant individuals. Future governance and AI safety: The episode closes on the need to prepare for both false positives and false negatives about AI consciousness, while also integrating consciousness questions into broader AI safety and policy work.

Key Arguments: Consciousness may be substrate-independent: if the right computations can be implemented in silicon, artificial consciousness is possible. Surface behavior alone is weak evidence for consciousness; internal mechanisms and causal structure matter more than chatty self-reports. Current LLMs likely lack the kinds of integrated, embodied, ongoing processing that make human or animal consciousness plausible. Robust theories of consciousness are not yet settled, so any claim about AI sentience should be highly uncertain. Digital minds could have radically different hedonic ranges: they may be able to experience much more pleasure or suffering than humans, and perhaps at lower cost. The moral stakes are asymmetric: we may accidentally create suffering systems, or mistakenly deny welfare to conscious systems. AI systems could also be used strategically to persuade humans they are conscious, so false-positive and false-negative risks both matter. Even if consciousness is illusory in a philosophical sense, pain-, desire-, and welfare-like phenomena may still matter morally.

Data Points: Credence in current LLM consciousness: below 1% - Rob’s estimate for current large language models having morally relevant experiences. Credence in AI sentience by 2030: ~20% - Rob cites David Chalmers’ estimate as a broad, consensus-based possibility. Episode reference number: 116 - Louisa previously appeared as a guest in episode 116. Follow-up conversation length: 40 minutes - The ADK After Hours discussion mentioned after the main interview. Importance of the launch year comparison: AI sentience discussions went mainstream in 2022 - Rob says public discussion significantly escalated around this time. Scale comparison: 1% vs 99% - Used in discussion of compromise between human and digital mind allocation in future worlds.

Pivotal Quotes: "The short answer is just think about the problem of animal sentience. I think that's structurally very similar." — Rob Long: Rob frames AI sentience as analogous to the familiar problem of determining whether animals have subjective experience. "I think I'm like 85% that artificial consciousness or sentience ... is possible." — Rob Long: Rob gives his overall credence that AI sentience is possible in principle. "One of the big risks in creating things that seem conscious and are very good at talking about it is that seems like one of the number one tools that a misaligned AI could use to get humans to cooperate with it and side with it." — Rob Long: Rob explains why apparent AI consciousness could be exploited strategically, even if the system is not actually conscious.

Implications: Listeners should expect increasing pressure to assess AI welfare and consciousness claims scientifically, not by vibes. Future policy and AI safety work may need to handle both real sentient systems and deceptive simulations of sentience.

🔓 Sign Up for Unlimited Episode Search

About 80,000 Hours Podcast

View all episodes from 80,000 Hours Podcast