The TWIML AI Podcast
The TWIML AI Podcast

Live from TWIMLcon! Overcoming the Barriers to Deep Learning in Production with Andrew Ng - #304

Earlier today, Andrew Ng joined us onstage at TWIMLcon - as the Founder and CEO of Landing AI and founding lead of Google Brain, Andrew is no stranger to knowing what it takes for AI and machine learning to be successful. Hear about the work that Landing AI is doing to help organizations adopt moder

Featured Speakers

Andrew Ng Guest

Topics Discussed

Episode Summary

Executive Summary: Andrew Ng discusses how AI is moving beyond software/internet into industries like manufacturing, agriculture, logistics, and healthcare. He explains Landing AI’s role as an outsourced AI partner, stresses starting with small high-value projects, building cross-functional teams, and using operational processes like rapid iteration, FME analysis, and data/versioning practices to overcome the gap between model development and production deployment.

Main Topics: AI adoption beyond software and internet companies (Priority: 5/5): Ng argues that the next major wave of AI will transform traditional industries, not just consumer internet businesses. Landing AI helps firms in sectors like manufacturing and agriculture become AI-enabled and more valuable. Landing AI’s role as outsourced chief AI officer (Priority: 5/5): Landing AI partners with companies to identify use cases, build AI capability, train teams, and develop IP, with the goal of eventually transferring the function in-house. How to choose the right first AI projects (Priority: 5/5): Ng recommends starting small with feasible, valuable projects rather than glamorous moonshots. Early wins build trust, internal capability, and momentum for broader adoption. Operationalizing ML: iteration, MLOps, and data workflows (Priority: 4/5): The conversation emphasizes that real-world ML requires more than model building: rapid iteration, experimentation cadences, monitoring, data editing/versioning, and systematic MLOps practices are essential. Robustness, generalization, and production risk management (Priority: 4/5): Ng highlights the mismatch between test-set performance and production reality, especially in settings with small data or shifting distributions. He describes pre-mortems and failure-mode analysis to anticipate deployment risks. The business and organizational side of AI transformation (Priority: 4/5): Success depends on executives, product managers, and engineers having a basic AI literacy and working together to define strategy, data access, and value creation. Tools reduce accidental complexity, not essential complexity (Priority: 4/5): Ng distinguishes between tooling improvements that simplify implementation and the harder problem of determining the right business problem, data, and workflow to solve.

Key Arguments: AI is as disruptive as the internet, so companies must rethink strategy, not just add AI features. Traditional industries can become much more effective and valuable by becoming AI-enabled. The best first project is usually not the CEO’s favorite or most glamorous idea; it should be feasible and demonstrably valuable. Early successful projects create internal credibility and help an organization learn how to use machine learning. Machine learning in production is constrained by limited data, distribution shift, and the need for systematic monitoring and mitigation. Many ML failures are organizational and process problems, not just technical model problems. Machine learning workflows often resemble debugging more than traditional software development, so rapid iteration is critical. Current tools still do not solve essential complexity such as problem selection, data acquisition, and business alignment. Data and test-set editing/versioning should be treated as legitimate production workflows, even if they would be unacceptable in academic benchmarking. Cross-functional collaboration between ML experts and business leaders is necessary to identify useful projects and scale them successfully.

Data Points: Nova’s age: 7 months - Ng says his daughter Nova is now seven months old. Daily sprint cycle: 1-day sprint - He describes a workflow where teams review overnight experiments each morning, work during the day, and rerun experiments overnight. Typical training time for the one-day sprint workflow: 4–5 hours - He says the daily cadence works best when model training takes roughly four or five hours. Project evaluation window: a few weeks - Ng recommends brainstorming at least half a dozen projects and evaluating feasibility and value over a few weeks before committing resources. Planning horizon to validate projects: months - He warns against investing a few months’ worth of resources into the wrong project too early. Speaker reference to prior paper: 30-year-old paper - Ng mentions rereading Fred Brooks’ No Silver Bullet, a 30-year-old paper on software complexity.

Pivotal Quotes: "AI, arguably, is as disruptive as the internet." — Andrew Ng: He explains why companies in every industry need to rethink competitiveness and strategy. "The hard part of software engineering is not, you know, do you use a go-to statement... It is thinking through clearly what is the problem and what are the steps needed to solve it?" — Andrew Ng: He contrasts tooling improvements with the enduring challenge of defining the right problem and workflow. "Machine learning workflow feels more like debugging than development." — Andrew Ng: He describes why rapid experimentation and error analysis are central to building production ML systems.

Implications: Listeners should expect AI adoption to hinge on strategy, data, and process—not just model accuracy. The biggest opportunities are in non-tech industries, where disciplined experimentation, cross-functional teams, and production-ready ML operations will separate winners from stalled pilots.

🔓 Sign Up for Unlimited Episode Search

About The TWIML AI Podcast

View all episodes from The TWIML AI Podcast