The a16z Podcast
The a16z Podcast

OpenAI Researchers on the Future of Mathematical Reasoning

a16z Infra Partner Lisha Li sits down with OpenAI mathematicians Mehtaab Sawhney and Mark Sellke to discuss how quickly AI’s mathematical capabilities are advancing, what recent results reveal about model reasoning, and what happens when AI begins making progress on problems mathematicians have stru

Featured Speakers

a16z HostMark Selke GuestMethab Swani Guest

Topics Discussed

Episode Summary

Executive Summary: The episode explores how AI—especially OpenAI’s reasoning models—is changing mathematics by solving problems through search, backtracking, and judgment more like a human expert than brute force. Lisa Lee speaks with mathematicians Methab Swani and Mark Selke about recent breakthroughs in sphere packing, coding theory, and group theory, and the broader impact on how math is done, understood, and shared.

Main Topics: AI as a new mathematical collaborator (Priority: 5/5): The guests explain that modern reasoning models can execute mathematical ideas, backtrack, and prune dead ends in ways that resemble expert mathematical work, making them useful not just for search but for substantive proof development. Why recent math results are surprising (Priority: 5/5): They emphasize that the results are not just benchmark wins or brute-force outputs; the model made nontrivial choices, connected ideas across fields, and produced short, elegant proofs for hard open problems. Sphere packing and the linear programming bound (Priority: 5/5): A deep dive into the sphere packing result: the model analyzed the high-dimensional LP bound, derived the asymptotic constant, and showed the bound is optimal within that framework. Coding theory and representation theory (Priority: 4/5): The discussion covers spherical and binary codes, where the model improved bounds using symmetry and representation theory, then pushed those ideas further to recover the sphere-packing asymptotics. The non-sofic group result (Priority: 4/5): The guests discuss the proof that non-sofic groups exist, its connection to earlier conjectures about approximating infinite structures by finite ones, and why the AI-generated proof was short and combinatorial rather than sprawling. How AI changes mathematical practice (Priority: 4/5): They argue that AI will reduce the bottleneck in proving results, increase the pace of understanding and absorption, and shift human effort toward taste, explanation, and community-level interpretation.

Key Arguments: The strongest AI math gains come from reasoning, backtracking, and judgment rather than brute-force generation. Models are especially good at executing a promising idea once a human or the model identifies the right direction. Mathematical papers and textbooks are poor training data for motivation and struggle, but reasoning models can still learn useful patterns of thought from them. Short, elegant AI-generated proofs suggest the models are finding structurally natural arguments rather than opaque search artifacts. The sphere packing breakthrough was significant because it solved the asymptotic behavior of the LP bound in high dimensions, not just a special case. The coding-theory result helped reveal a close relationship between finite-code optimization and sphere-packing geometry. The non-sofic group proof shows AI can handle subtle group-theoretic obstructions with a normal-looking, compact argument. As proving becomes less scarce, the mathematician’s role shifts toward explanation, synthesis, and deciding which problems are worth pursuing. AI may not solve the hardest grand challenges like P versus NP, but it can dramatically accelerate the surrounding landscape of mathematical progress. AI also helps mathematicians read and understand proofs much faster, increasing access to advanced mathematics.

Data Points: Problems released in Astra set: 10 - They refer to a set of ten problems used to showcase the model’s mathematical abilities. Dimension 1 sphere packing density: trivial / full coverage - A sphere in one dimension is just a unit segment, so the line can be completely covered. Dimension 2 sphere packing: hexagonal lattice - The classic optimal packing picture in the plane. Dimension 3 sphere packing proof length: a few hundred pages - Hales’s proof of the 3D sphere-packing result is described as long and delicate. Known exact sphere-packing dimensions: 5 dimensions: 1, 2, 3, 8, and 24 - They note that only these dimensions are known exactly in the discussion. Lower bound on sphere packing density: 2^-d - A simple bound obtained from a packing with no place to add another sphere. Best older exponential upper bound: 2^-0.59d - The historical upper bound mentioned for high-dimensional sphere packing. Model-derived asymptotic bound: ≈ 2^-0.601d - The model’s LP-bound asymptotics in high dimensions. Non-sofic group proof length: ~15 pages - They contrast it with much longer prior work on related conjectures. Aldous-Lyons disproof length: ~250 pages + another ~200 pages - Referenced as a much more elaborate prior result using quantum complexity theory. Time to find a reference via GPT-5: 5 minutes - One of the conversion moments: GPT-5 quickly located a reference for an Erdős problem. Human effort on same search: a few hours - They describe how humans may spend hours on such literature searches without certainty. Human time on an idea before giving up: hours to weeks - Used to contrast human persistence with models that keep trying. Human time on a math idea before rediscovery: 1-2 years later - They mention the common experience of learning later that a failed idea actually worked elsewhere. Model improvement prompt: “push this further” - They describe how a follow-up prompt elicited a more sophisticated representation-theoretic argument.

Pivotal Quotes: "“There are some other relative strengths and weaknesses. Another relative strength that's pretty noticeable is just like it's very good at executing on some idea once it has it.”" — Mark Selke: Explaining why reasoning models can make mathematical ideas work in practice even when humans hesitate or get stuck. "“This is the best part about this problem, which is really nobody has any idea.”" — Methab Swani: Describing the mystery and difficulty of high-dimensional sphere packing. "“The ceiling for difficulty of a math problem is pretty high.”" — Mark Selke: Arguing that even very capable AI will still leave room for major mathematical mysteries.

Implications: AI is moving math from proof scarcity toward interpretation, synthesis, and faster dissemination. Expect more short, high-quality proofs, broader access to advanced math, and a stronger premium on human judgment and problem selection.

🔓 Sign Up for Unlimited Episode Search

About The a16z Podcast

The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!

View all episodes from The a16z Podcast