Intelligence Squared
Intelligence Squared

Implementing and scaling AI agents in business

Many organisations are experimenting with AI and AI agents. But far fewer are seeing real, measurable impact. The challenge isn’t ambition, it’s readiness. As we explored in the first episode of this series, the challenge for most businesses isn’t ambition - it’s having the right foundations in plac

Topics Discussed

Episode Summary

Executive Summary: This episode argues that successful AI adoption in the workplace depends less on model choice and more on preparation: cleaning up data architecture, creating a secure single source of truth, starting with narrow high-value use cases, moving beyond chat into agentic workflows, and measuring real business value. Ben Kus of Box emphasizes that AI-ready companies build foundations now so they can scale safely as AI agents become more capable.

Main Topics: AI readiness starts with data, not models: Ben argues many companies think they have an AI problem when they really have a data problem. Unstructured and structured data are often fragmented across legacy systems, preventing AI from being useful at scale. Auditing data architecture and legacy systems: Companies should map where critical data lives, assess whether systems are modern and AI-accessible, and identify legacy silos that block AI agents from reaching the right information securely. Governance, access control, and compliance: AI must respect role-based and user-based permissions; otherwise, it will reveal information it can access regardless of whether a user should see it. Security and compliance are foundational, not optional. Start small with concrete use cases: Rather than attempting a sweeping transformation, organizations should pick one bottleneck or workflow, prove value, and build employee familiarity and confidence before expanding. Move beyond chat to AI agents and workflows: The conversation shifts from chatbots to agentic systems that can reason, use tools, operate asynchronously, and perform background work without constant prompting. Measure ROI with practical metrics: Success should be tracked through clear exit criteria, direct business outcomes, and laddered metrics that connect small process improvements to larger organizational goals.

Key Arguments: Many enterprises do not have an AI model problem; they have a data access and organization problem that prevents AI from being effective. Structured data in systems like Snowflake, Databricks, or Workday and unstructured data like files, emails, and presentations must be made available through modern platforms for AI use. AI agents should be treated like new employees: they can only deliver value if they have the right information, permissions, and tools. A top-down audit of data systems and a bottom-up look at the most painful workflows are both necessary to identify where AI can help. Organizations should not try to solve every problem at once; starting with simple, measurable use cases creates momentum and improves adoption. Governance is critical because AI does not inherently know permission boundaries and may expose restricted information if access controls are not enforced. The most successful pilots have clear exit criteria, a directly responsible person, and a problem that matters to the owner of the workflow. AI value increasingly comes from agentic systems that can act in the background, coordinate with other systems, and complete tasks without constant human prompting. High-level company KPIs usually do not move immediately; leaders need process-level metrics that ladder up to business outcomes over time. The AI landscape is changing rapidly, so companies should keep experimenting as models and capabilities improve rather than assuming past tests still reflect current possibilities.

Data Points: Major model releases: about 15 - Ben says there have been roughly 15 major model releases across vendors in the last 12 months. Pilot workflow improvement example: 10 hours to 20 minutes - A department-level AI use case reduced a manual process from about 10 hours to 20 minutes. Process speedup example: 10x faster - The discussion frames successful AI pilots as achieving roughly 10 times faster execution on specific workflows. Time horizon: next 3 to 6 months - The host asks what leadership decisions should be made over the next few months to prepare for AI integration.

Pivotal Quotes: "We don't actually have an AI problem. Instead, we have a data problem." — Ben Kus: Explaining why data architecture and access are the real barriers to AI adoption. "AI doesn't keep secrets." — Ben Kus: Warning that AI will reveal whatever it can access unless permissions are enforced carefully. "start small is definitely one of the things that is typically a focus area for people that we see who are more successful." — Ben Kus: Describing the recommended approach to launching AI initiatives.

Implications: For leaders, AI readiness means modernizing data foundations, enforcing governance, and choosing practical agentic use cases. The winners will be organizations that experiment deliberately, prove ROI quickly, and scale as AI capabilities evolve.

🔓 Sign Up for Unlimited Episode Search

About Intelligence Squared

View all episodes from Intelligence Squared