Practical AI
Practical AI

Learning to learn deep learning đź“–

Chris and Daniel sit down to chat about some exciting new AI developments including wav2vec-u (an unsupervised speech recognition model) and meta-learning (a new book about “How To Learn Deep Learning And Thrive In The Digital World”). Along the way they discuss engineering skills for AI developers

Featured Speakers

Chris Benson GuestDaniel Whitenack Guest

Topics Discussed

Episode Summary

Executive Summary: Practical AI co-hosts Daniel Whitenack and Chris Benson discuss how to enter and build a career in AI as the field matures. They examine varied team structures and career paths, recommend learning through practical projects, and explain how organizational adoption depends on understanding users’ needs. They also discuss wav2vec-U as a way to learn speech representations from untranscribed audio and highlight the need to navigate differing MLOps tools and workflows.

Main Topics: AI career paths and team structures: The hosts describe the range of roles in AI, from research and model development to engineering, deployment, and integration. Organizations also differ in whether they centralize AI teams or embed specialists across teams, with no universally best arrangement. Practical projects as a route into AI: Daniel proposes a question-answering project that uses an existing model and makes it available through a REST API, a user interface, and batch inference. He says this demonstrates how a model can be applied in different settings, while fine-tuning could extend the exercise. wav2vec-U and low-resource speech: The hosts discuss Facebook’s wav2vec-U, which learns from untranscribed audio and uses adversarial training involving generated speech units and units derived from text. Daniel highlights its potential relevance to languages that have audio recordings but little or no transcribed data. Maturing AI practice and implementation: They consider whether recent progress is more evolutionary than revolutionary, noting that established workflows and accessible tooling let more practitioners build and deploy sophisticated models. AI is increasingly treated as part of ordinary software engineering rather than a separate discipline. Introducing AI within organizations: Daniel argues that adoption requires empathy for colleagues’ pain points and involving end users early. A successful initial project can build momentum, while a poorly chosen or executed first effort can create lasting skepticism. Lifelong learning and MLOps resources: The hosts stress continuous self-directed learning and choosing resources that fit one’s goals. They note that MLOps courses may teach distinct ecosystems—such as TensorFlow Extended, GitHub Actions, or enterprise platforms—so learners should understand the underlying practices, not only one toolchain.

Key Arguments: AI work spans research, data science, software engineering, and deployment; individuals should identify which work interests them because the required skills and career paths differ. A useful portfolio project should show how a model serves users in practical contexts, not just how to build or run the model. The proposed question-answering exercise covers API access, interactive use, and batch processing. Centralized and embedded AI teams each have trade-offs: centralized groups must maintain strong ties to users, while distributed groups risk duplicated work and fragmented resources. Organizational AI adoption is more likely to succeed when practitioners understand users’ real problems and involve them early; a bad first experience can undermine future adoption. Untranscribed audio is a valuable but underused resource for low-resource languages. Methods that learn from unpaired audio and text could make speech transcription efforts more feasible. Because learning materials and MLOps ecosystems vary, learners should select a practical goal, build a learning path around it, and abstract common principles so their skills transfer between tools. Continuous lifelong learning is essential because algorithms, workflows, and formal training can become outdated even while foundational skills such as mathematics remain useful.

Data Points: Question-answering project delivery modes: 3 - Daniel proposed exposing the same model through a REST API, a user interface, and batch inference. Example batch dataset sizes: 20,000; 50,000; 100,000 - Illustrative question-and-passage dataset sizes used when discussing batch inference, not reported experimental results. Transcribed speech data requirement: Thousands of hours - The hosts describe the substantial amount of high-quality transcribed audio often needed for speech recognition. Podcast duration at the time of recording: Nearly 3 years - The hosts reflect on how AI deployment and the surrounding landscape have changed since the podcast began.

Pivotal Quotes: "If you are thinking about how to get there, you have to build in constant lifelong learning into your process." — Chris Benson: He emphasizes that ongoing learning is necessary to build and sustain a career in a rapidly changing digital field. "the more that I think they can feel truly listened to, and that you understand their pain points and why they go about the way that they're solving those problems now and the challenges that they're having, the better chance you have" — Daniel Whitenack: He explains why empathy and early engagement with organizational users are central to successful AI adoption. "having a personal significant use case, something that you want to get done" — Chris Benson: He recommends learning AI by pursuing a concrete, personally motivating project rather than studying tools without a practical goal.

Implications: AI careers increasingly require both technical depth and the ability to deliver useful systems. Learners should keep updating their skills, practice with real use cases, and develop transferable understanding across tools. Organizations should ground AI efforts in user needs and treat deployment as part of software engineering.

🔓 Sign Up for Unlimited Episode Search

About Practical AI

View all episodes from Practical AI