Practical AI
Practical AI

Building a data team

Inspired by a recent article from Erik Bernhardsson titled “Building a data team at a mid-stage startup: a short story”, Chris and Daniel discuss all things AI/data team building. They share some stories from their experiences kick starting AI efforts at various organizations and weight the pro and

Featured Speakers

Chris Benson GuestDaniel Whitenack Guest

Topics Discussed

Episode Summary

Executive Summary: Daniel Whitenack and Chris Benson discuss lessons from building data and AI teams: define the organization’s real needs before hiring, cover the full path from business problem to production, and address fragmented data and culture before pursuing sophisticated models. They emphasize educating executives, communicating value in business terms, prototyping to demonstrate usefulness, and gradually decentralizing collaboration as teams grow.

Main Topics: What a data team needs to do: The hosts note that “data team” has no universal definition. Its responsibilities may span analytics, data science, engineering, operations, deployment, and research, and organizations are still developing mature team structures. Hiring for the end-to-end workflow: Hiring only specialists in modeling can leave major gaps in SQL, containers, DevOps, and deployment. Leaders should identify the skills needed at each stage—from defining the business problem to operating a useful model—and staff accordingly. Data readiness and business priorities: Organizations may need accessible metrics and aggregated, usable data before machine learning. Existing data can be fragmented, hard to query, or unsuitable for the intended model, even when plenty of it is collected. Culture and adoption of data-driven decisions: Teams may rely on established expert judgment rather than consistent evidence. Building trust requires understanding existing motivations and practices, then showing how data can improve decisions without dismissing colleagues’ experience. Executive communication and prototyping: Technical leaders must explain value in terms stakeholders understand and avoid AI for its own sake. Lightweight prototypes can test feasibility, reveal deployment needs, and demonstrate value before larger investment. Scaling collaboration and leadership: Centralized management can help establish standards early, but may become a bottleneck as projects multiply. Growing teams need more direct communication, thoughtful delegation, and management that recognizes individuals’ strengths and development needs.

Key Arguments: A team of mathematically strong data scientists is not necessarily equipped to deliver production systems; the speaker’s past hiring experience exposed gaps in SQL, containers, DevOps, and deployment. Staffing should reflect the full workflow from understanding the business problem through implementation and production, with roles adjusted to budget and the capabilities of available candidates. The immediate business need may be basic data access and reliable metrics rather than advanced AI; pursuing models before fixing data fragmentation can waste effort. Data collection alone does not ensure model readiness: telemetry may help diagnose failures but still lack the information needed to train a model for a desired capability. Leaders need to communicate proposed AI work in accessible, business-relevant terms, provide evidence for its value, and recognize when simpler or less costly methods are sufficient. A working prototype can make value and feasibility visible, while also exposing whether the solution can be deployed with available resources. As organizations grow, effective data work depends on culture, trust, and communication with other teams—not only on technical capability.

Data Points: PSSC Labs’ experience: More than 25 years - The sponsor description says the HPC and AI solutions provider has served enterprise computing needs for this long. Startup scale in the article discussed: Around 10 million - The hosts describe the article’s mid-stage startup scenario and compare it with the scale of Daniel’s wife’s business; the transcript does not specify a currency or unit. Agile adoption timeframe: Beginning of the 2000s; the following 20 years - Chris recalls the agile movement emerging around the beginning of the 2000s and says the mindset took roughly the next two decades to gain broad acceptance. Illustrative model accuracy: 90% - Daniel gives a hypothetical example of reporting test-set accuracy to executives; it is not a result from a project described in the episode.

Pivotal Quotes: "I would hire in to reflect the entire workflow." — Chris Benson: His approach to assembling a team that can move work from problem definition through deployment. "It's your job to show them. It's not on them." — Chris Benson: His point that technical leaders must communicate a project’s value in terms nontechnical stakeholders can understand. "If your answer is, oh, I haven't thought about that yet, or it only runs on the GPU server, or I don't know how to like extract it. We have to figure out that problem. Do you want to invest in that? It doesn't really inspire a lot of confidence, right?" — Daniel Whitenack: He explains why a model demonstration should address practical delivery and deployment, not only training results.

Implications: Organizations should align AI hiring and investment with genuine business needs, build data foundations before advanced modeling, and treat communication and adoption as core technical work. Prototypes and end-to-end thinking can reduce wasted effort and help teams scale sustainably.

🔓 Sign Up for Unlimited Episode Search

About Practical AI

View all episodes from Practical AI