The TWIML AI Podcast
The TWIML AI Podcast

Towards Artificial General Intelligence with Greg Brockman - TWiML Talk #74

The show is part of a series that I’m really excited about, in part because I’ve been working to bring them to you for quite a while now. The focus of the series is a sampling of the interesting work being done over at OpenAI, the independent AI research lab founded by Elon Musk, Sam Altman and othe

Featured Speakers

Greg Brockman Guest

Topics Discussed

Episode Summary

Executive Summary: Greg Brockman traces OpenAI’s origins to a conviction that AI was becoming real and transformative, and argues that the field’s future depends as much on safety, governance, and compute as on algorithms. He emphasizes scalable learning, rapid hardware progress, and the need to shape AGI so it benefits humanity broadly rather than a single company.

Main Topics: Greg Brockman’s path into programming and AI (Priority: 4/5): Brockman describes how teaching himself to code after a chemistry-textbook setback led him to computer science, startups, Stripe, and eventually a full-time commitment to AI after seeing deep learning’s practical progress. Why OpenAI was founded (Priority: 5/5): He explains OpenAI as a response to rapid AI progress and the belief that a lab could both push the frontier and ensure the technology’s benefits are shared safely and broadly. OpenAI’s structure and openness (Priority: 4/5): Brockman frames OpenAI as combining the best of academia and industry, with teams spanning robotics, Dota, and infrastructure, while arguing that openness must be judged by long-term impact rather than maximal short-term release. AGI safety, values, and governance (Priority: 5/5): A major theme is that the technical problem of making AI follow human intent is hard but solvable, while the harder challenge is deciding whose values AGI should reflect and how to govern it for humanity’s benefit. Compute and hardware as the key accelerant (Priority: 5/5): Brockman argues that data-center-scale training and faster neural-net hardware are driving AI progress and will continue to do so, making future breakthroughs in vision, speech, video, and robotics much more likely. Near-term transformative applications (Priority: 4/5): He highlights synthetic video, speech synthesis, and robotics as areas where the next few years could bring dramatic change, driven by learning methods and large-scale compute. What AGI means and why timelines are hard (Priority: 4/5): He defines AGI functionally—as a system that can perform any economically valuable task as well as a human—while cautioning that precise timelines are inherently unreliable and often distorted by philosophical ambiguity.

Key Arguments: AI is becoming practical because researchers can now build systems that solve tasks that were previously impossible, not merely fashionable. OpenAI’s mission is not just to build AGI, but to steer it so the world after AGI is good for humans. Openness should be measured by long-term societal value, not by releasing every codebase or dataset immediately. The main technical safety challenge is training systems to reflect human values through human feedback and other alignment methods. The bigger non-technical challenge is governance: determining whose values AGI should optimize and how that power is distributed. Compute is becoming the primary bottleneck and accelerator; larger clusters and specialized neural hardware will unlock new capabilities. Many near-term AI breakthroughs—video generation, speech synthesis, robotics—are constrained more by compute than by idea quality. AGI may emerge as an organization of specialized modules rather than one monolithic mind, similar to how teams of humans outperform individuals on complex tasks. It is difficult to predict AGI timelines because people reason from today’s systems and because breakthroughs tend to arrive suddenly once enabling conditions are met.

Data Points: OpenAI launch year: December 2015 - Brockman says OpenAI was launched at NIPS in December 2015. Stripe growth under Brockman: 4 people to 250 employees - He notes he served as CTO at Stripe for five years and helped scale the company. Current Stripe scale mentioned: around 1,000 employees - Brockman references Stripe’s later size as context. Human feedback example: 500 bits of feedback - He cites an OpenAI/DeepMind collaboration showing that 500 bits of feedback could train an AI to do backflips. Early ImageNet hardware example: 2 GPUs - He contrasts early 2012-era results with later scale-up in training. Intermediate scale example: 8 GPUs - He cites 2014 as a stage where 8-GPU training seemed impressive. Large-scale training example: 256 GPUs - He references Facebook training ImageNet on 256 GPUs in about an hour. Very large-scale training example: 1024 GPUs - He notes another result training ImageNet in 15 minutes on 1024 GPUs. NVIDIA Pascal performance: ~20 teraflops - He gives Pascal as a 2016 baseline for neural-net compute. NVIDIA Volta performance: ~90 teraflops - He says Volta roughly quadrupled Pascal’s flops for neural nets. Google TPU 2.0 performance: ~180 teraflops - He cites TPU 2.0 as another leap in accelerator capability. Backpropagation origin: 1986 - He notes the learning algorithm they use dates to 1986. Representative earlier AI paper: 1950 - He references Turing’s paper 'Computer Machinery and Intelligence' from 1950.

Pivotal Quotes: "AI is just going to be the most transformative technology that humans ever create." — Greg Brockman: Explaining why he committed to OpenAI and viewed the mission as historically important. "The goal of OpenAI is to ensure that the world post-general intelligence is good for humans." — Greg Brockman: Defining the organization’s central purpose and safety-oriented mission. "Can you build a system that is able to accomplish any economically valuable task that you put in front of it?" — Greg Brockman: His functional definition of AGI during a discussion of what AGI should mean.

Implications: Listeners should take away that AI progress is being driven by scale, hardware, and better training methods, but the decisive challenge is alignment and governance. The industry may soon face powerful synthetic media and robotics advances, making safety, policy, and broad benefit distribution urgent.

🔓 Sign Up for Unlimited Episode Search

About The TWIML AI Podcast

View all episodes from The TWIML AI Podcast