Masters of Scale
Masters of Scale

AI + You | 5 steps for impactful experimentation

AI can be overwhelming. In this 3-part series, we offer business leaders an actionable playbook to best implement AI. Part one: To unleash AI’s true power of scale, you must dive headfirst into ongoing experimentation. To guide you, host Reid Hoffman speaks to Stanford HAI’s Fei-Fei Li, Inflection’s

Featured Speakers

WaitWhat HostReid Hoffman GuestPriya Krishna GuestMael Gave Guest

Topics Discussed

Episode Summary

Executive Summary: Reid Hoffman frames AI adoption as an iterative, experimental process rather than an overnight transformation. Drawing on Priya Krishna’s AI-generated Thanksgiving cooking experiment and interviews with AI leaders from Microsoft, Google DeepMind, Stanford, and Techstars, the episode argues that businesses should learn what AI can do, target pain points, align teams with concrete demos, onboard AI like a new employee, and experiment carefully with security and human oversight.

Main Topics: AI as ongoing experimentation, not instant revolution: The episode’s core thesis is that AI creates value through repeated testing, learning, and refinement—not by delivering immediate business transformation. Learning the AI landscape before adopting: Leaders should understand what tools exist, assess timing, and recognize that AI readiness differs by business needs and resources. Targeting real pain points: AI works best when applied to specific operational problems, especially in complex domains like healthcare and knowledge work. Winning team buy-in through demonstrations: Rather than pitching AI abstractly, leaders should show practical use cases, define metrics, and let early wins build adoption. Treating AI like a new employee: The episode recommends onboarding AI gradually, giving it limited responsibility at first, then expanding trust through feedback loops. Safety, privacy, and responsible experimentation: Leaders are urged to experiment with AI while protecting sensitive data, managing expectations, and remaining alert to limits and discomfort. AI’s creative potential and limits in everyday work: Priya Krishna’s Thanksgiving experiment illustrates both AI’s surprisingly creative output and its inability to replace human judgment or taste.

Key Arguments: AI should be adopted through continuous experimentation because its capabilities, limitations, and best use cases are still evolving. Specific, well-scoped prompts and use cases produce more useful AI output than vague requests. AI is most effective as an assistant or collaborator, not as a full replacement for human expertise and judgment. Teams adopt AI more readily when they see it solving visible problems and saving time in real workflows. Healthcare examples show AI can improve quality and efficiency when focused on concrete operational pain points. Human feedback dramatically improves model performance, making the human-in-the-loop essential. Security, privacy, and governance must shape where and how companies test AI, especially with sensitive data. Organizations should expect discomfort and mistakes during AI rollout; those failures are part of learning and scaling.

Data Points: Business growth with PEOs: Twice as fast - Mentioned in sponsor copy for Deal, citing the National Association of PEOs Thanksgiving timing: Final Thursday of every November - Describing the holiday setting for Priya Krishna’s AI cooking experiment Hospital-acquired infections vs. car accidents: Three times more Americans every year - Fei-Fei Li explaining why hand hygiene matters in hospitals AKI deaths in the UK: Around 100,000 patients every year - DeepMind Health’s motivation for predicting acute kidney injury Potentially preventable AKI cases: Up to 30% - Experts believed early intervention could prevent a portion of AKI cases AKI treatment cost reduction: 20% - Streams app reduced the cost of treating acute kidney injury AKI detection speed: From 4 hours to 15 minutes - Streams app improved time to detect acute kidney injury Model improvement with feedback: 20-30% higher solve rate - David Luan describing how one human correction improved LLM task performance Compute growth over a decade: 10x - Mustafa Suleiman noting the increase in compute used to train leading AI models Lambda team size: 6 employees - Mustafa describing the early research project before broader productization Episode’s original guidance: 5 steps - Reid Hoffman’s framework for experimenting impactfully with AI AWS Activate credits: Up to $100,000 - Sponsor offer for startups building on AWS

Pivotal Quotes: "AI won't revolutionize your business overnight. To unleash AI's true power of scale, you must dive headfirst into an era of ongoing experimentation." — Reid Hoffman: Episode thesis and framing statement "AI can be very good as sort of a kitchen assistant rather than perhaps the kitchen leader." — Priya Krishna: After testing AI-generated Thanksgiving recipes "It's a marathon, not a sprint. You do not have to run at full speed because right now, right here, it's only 100 meters." — Mael Gave: Advice for founders worried about falling behind on AI

Implications: For leaders, the message is to start small, measure outcomes, and build AI into workflows gradually. The winners will be organizations that combine experimentation, human judgment, and strong data safeguards.

From the Episode

Cooking creative, exciting, and accessible. Even though the AI's integration was far from a triumph, it encouraged Priya to step outside of her comfort zone and open her eyes to new ideas. Every business leader should take inspiration from Priya's willingness to invite AI into the kitchen and experiment. With patience and an open mind, the potential is boundless. That's why I believe that AI won't revolutionize your business overnight. To unleash AI's true power of scale, you must dive headfirst into an era of ongoing experimentation. Well, we can talk about AI. We can think about it. When most people think about AI, they think about killer robots. Things are changing every couple of months. AI is at an infection point. It is a switch. It's like we have power tools now. And we'll just keep figuring it out. It helps unlock a whole different approach. Generative AI is the most excited I've been about anything in software since the internet. It's definitely a super exciting time to be in this space. All of these things are possible. Let's try to figure out whether this is actually useful or not. The tech just shouldn't replace human beings.

Reid Hoffman · at 5:42

The general consensus was: if I went to someone's Thanksgiving dinner and they served this, I'd be ordering pizza afterwards. Despite GPT's lack of culinary success, Priya came away with some optimism. There are plenty of uses for AI in cooking. You could tell AI: I've got mushrooms and chicken broth and green beans in my fridge. What are some things I could make? And AI could give you ideas. I'm cooking chicken. Thighs, what temperature should they be at to be considered fully cooked? What is the roasting temperature for sweet potatoes that are cut into cubes? AI can be very good as sort of a kitchen assistant rather than perhaps the kitchen leader. Priyo is only able to make this useful discovery through experimentation. No chef expects to create a flawless dish on their first attempt. They know from experience that commitment and patience are key in finding the perfect balance of flavors, textures, and smells. Although AI lacks the distinctly human senses and emotions needed to enjoy a turkey with all the trimmings, it can still help us come together and experiment and collaborate to make.

Priya Krishna · at 4:22

Thorough preparation is essential for any experiment. So let's begin by exploring some of the preliminary questions that leaders must consider before weaving AI into their business. Our first AI thought leader is Mael Gave. Mael is the CEO of Techstars, a global investment firm that focuses on early-stage startups. She currently mentors countless entrepreneurs who are transitioning to AI. I think there's a lot of people right now who are like, oh my god, This new wave of innovation coming at me. I'm not an engineer. I'm really worried that I'm going to be left behind. I don't have the resources. I don't have the skills. Like, what do I do? If you can relate, Maya offers some sage advice. It's a marathon, not a sprint. You do not have to run at full speed because, right now, right here, it's only 100 meters. You need to save your energy and your resources to get to the finish line. It's important to go through the finish line, but you don't have to be the first one. That's okay too.

Mael Gave · at 9:54
🔓 Sign Up for Unlimited Episode Search

About Masters of Scale

On Masters of Scale, iconic business leaders share lessons and strategies that have helped them grow the world's most fascinating companies. Founders, CEOs, and dynamic innovators join candid conversations about their triumphs and challenges with a set of luminary hosts, including founding host Reid Hoffman (LinkedIn co-founder and Greylock partner). From navigating early prototypes to expanding brands globally, Masters of Scale provides priceless insights to help anyone grow their dream ente...

View all episodes from Masters of Scale