Search Engine
Search Engine

Who should be in charge of AI?

This week, the story of a very brief, very absurd revolution at the world’s leading artificial intelligence company, OpenAI. And we try to answer the quite real question that might be animating all of the drama. Check out Casey Newton's newsletter Platformer and our newsletter, too.

Featured Speakers

Sam Altman Guest

Topics Discussed

Episode Summary

Executive Summary: The episode examines OpenAI’s chaotic 2023 board coup and reinstatement of Sam Altman as a case study in who should control transformative AI. It traces OpenAI’s unusual nonprofit-plus-for-profit governance, argues the firing was more about trust and power than pure AI safety, and concludes that AI regulation and oversight are now unavoidable because the technology is too consequential to leave solely to companies.

Main Topics: The OpenAI board coup and Altman’s reinstatement: A sudden board firing of Sam Altman triggered employee revolt, Microsoft intervention, and a rapid reversal that exposed deep governance tensions inside OpenAI. Who should be in charge of AI?: The episode frames the OpenAI saga as part of a larger question about authority, legitimacy, and oversight over a technology that may exceed human capabilities. OpenAI’s unusual governance structure: OpenAI was designed as a nonprofit controlling a for-profit subsidiary, with a board meant to restrain commercial pressure and keep the mission focused on safety. The evolution from research lab to global platform: OpenAI went from a nonprofit research project to the fastest-growing consumer app in history after ChatGPT, making Sam Altman the public face of AI. Safety advocates vs. corporate power narratives: Casey Newton argues the coup was not simply safety-minded idealists versus profit-seeking executives; the conflict appears to have centered on leadership style, trust, and internal power. Regulating AI at the governmental level: The discussion ends with the view that governments, especially the U.S. and Europe, will need to set rules, test capabilities, and possibly fund public AI research.

Key Arguments: Power and governance questions are central to AI because the technology could become vastly more capable than humans. OpenAI’s board structure was intentionally unusual because its founders feared concentrating control of superintelligence in a normal for-profit company. Sam Altman’s firing was shocking because there were very few plausible reasons to remove such a consequential founder without warning. The public narrative that the board fired Altman purely over AI safety likely oversimplifies the conflict; the deeper issue was trust and internal governance. The AI safety community’s public image suffered because the board could not clearly explain its decision, making it look like a failed revolution. Even if the coup was messy, it brought more scrutiny to AI safety and governance, which may ultimately be beneficial. Government oversight will likely be necessary, and Europe may end up setting many of the practical rules as it does with other tech regulation.

Data Points: OpenAI employee petition: 90% of 770 employees signed - Employees threatened to leave unless Altman was reinstated and the board resigned. OpenAI staffing revolt: 95%+ of the company - The transcript says more than 95% of employees threatened to walk out during the standoff. ChatGPT user growth: 1 million users in 5 days - The app reached this mark shortly after launch in November 2022. ChatGPT monthly active users: 100 million in 2 months - Presented as the fastest-growing consumer app in history. AI inference cost: about 30 cents per question - Estimated cost to OpenAI for each ChatGPT query. OpenAI valuation context: $100 billion to $200 billion scale - Described as the funding level needed for frontier AI development. OpenAI founding year: 2015 - The company was founded as a nonprofit research effort. OpenAI board transition duration: 5 days - The standoff from Altman’s firing to his reinstatement lasted five days. Founder removal precedent: Uber / Travis Kalanick - Cited as the closest prior Silicon Valley founder-removal drama.

Pivotal Quotes: "Who should be in charge of artificial intelligence?" — PJ Vogt / episode framing: The central question introduced at the start of the episode. "OpenAI was founded on the belief that artificial intelligence has the potential to improve nearly every aspect of our lives, but also that it creates serious risks we have to work together to manage." — Sam Altman: Altman’s congressional testimony summarizing OpenAI’s mission. "I truly believe that the core conflict was not really about AI safety... I think the board was actually fairly comfortable where things were from a safety perspective. I think they were just worried about the lying that they say he was doing." — Casey Newton: Newton’s interpretation of the firing as a governance/trust issue rather than a pure safety showdown.

Implications: AI will likely require real public oversight, not just company self-governance. OpenAI’s turmoil shows that as models get more powerful, disputes over trust, mission, and control will shape the industry—and governments may soon have to set the rules.

🔓 Sign Up for Unlimited Episode Search

About Search Engine

View all episodes from Search Engine