Big Technology Podcast
Big Technology Podcast

Meta's Big Llama 3 Release, Google's New Culture, MKBHD vs. Humane

Alex Heath from The Verge is back for our weekly discussion of the latest tech news. We cover 1) Taylor Swift's new album 2) Meta's new Llama 3 release 3) Does conversational AI work in a social media products? 4) Will the value of generative AI be realized in foundational models or produc

Featured Speakers

Alex Kantrowitz HostSundar Pichai Guest

Topics Discussed

Episode Summary

Executive Summary: The episode centers on Meta’s Llama 3 launch, arguing that AI competition is shifting from model quality to distribution and product integration. It also covers Google’s firings of protesting employees and a broader culture shift under Sundar Pichai, then closes with a defense of reviewers like MKBHD, insisting bad products—not honest criticism—kill companies.

Main Topics: Meta Llama 3 and AI distribution strategy (Priority: 5/5): Alex Heath and the host discuss Meta’s Llama 3 release, its open-source positioning, and Zuckerberg’s plan to embed Meta AI across WhatsApp, Instagram, Facebook search, and other surfaces to leverage distribution against ChatGPT and rivals. Productization vs. model race in AI (Priority: 5/5): The conversation argues that as frontier models converge, the real economic value will come from how AI is integrated into products, plus chips and infrastructure, rather than model benchmarks alone. Zuckerberg’s AI ambition and Meta’s cultural rebrand (Priority: 4/5): They examine Zuckerberg’s increasingly public, confident persona, his push to make Meta AI the most-used assistant, and how his image and leadership style are helping recruit talent and recast Meta as an innovation leader. Google firing protesting employees and tightening workplace rules (Priority: 5/5): They discuss Google’s firing of 28 employees over office sit-ins tied to the Israel contract, Sundar Pichai’s memo emphasizing mission focus, and a broader shift from permissive internal activism to stricter workplace discipline. Open-source AI safety and limits (Priority: 4/5): The discussion weighs Meta’s open-source philosophy against risks from powerful models, especially multimodal capabilities like image generation in an election year, and notes that Meta may open-source text models but hold back some features. MKBHD, reviews, and the ethics of criticism (Priority: 5/5): The final segment defends Marques Brownlee’s harsh reviews of Humane and Fisker, arguing that reviewers have a duty to be honest and that poor products, not negative reviews, are what destroy companies.

Key Arguments: Meta’s biggest advantage in AI is not just its models but its distribution across billions of users in messaging and social apps. Embedding AI inside WhatsApp, Instagram, and Facebook search may feel odd to some users, but Meta believes conversational AI belongs in messaging environments. OpenAI and Anthropic have smaller default reach; Meta can use scale and iteration to improve its assistant faster. The AI model race is becoming less decisive as the market converges; the real moat will be product experience and infrastructure. Google’s firings signal a real change: employee activism is being curtailed in favor of company mission and operational focus. Sundar Pichai’s memo and Chris Rackow’s warning show Google is drawing a sharper line against disruptive internal protest. Reviews are meant to be honest and helpful to consumers; if a product is bad, criticism did not cause the failure. Marques Brownlee’s influence reflects trust, not unethical power; he is accountable to viewers, not to preserving weak startups. Open source is generally good, but Meta is appropriately considering safety limits for modalities like image generation. Zuckerberg’s public reinvention—more visible, more combative, more product-focused—helps Meta recruit talent and compete culturally with OpenAI and Google.

Data Points: Llama downloads: over 100 million - Meta says Llama has been downloaded more than 100 million times and is already embedded in many apps. Llama 3 big model size: 400 billion parameters - A larger Llama 3 model is expected this summer and is described as unusually large for an open-source release. Data used for training: 10 times more data - Meta said Llama 3 used 10x the data of previous versions. Compute used for training: 100 times the compute - Meta said Llama 3 used 100x the compute of earlier models. Google employees fired: 28 - Google fired employees involved in the sit-in protest over the Google Cloud Israel contract. Employees arrested: 9 - Nine protesters were reportedly arrested and physically removed from offices before the firings. Google stock move: up a bunch yesterday; down 3.5% today - The host notes investor reaction to Meta’s model news and subsequent trading reversal. Meta GPU order: 650,000 GPU equivalents by end of year - Heath says Meta’s massive GPU purchase was made before GPT-4 and now supports Llama training. MKBHD YouTube audience: 18 million subscribers - A critic’s post argued Brownlee had too much reach to publish a harsh review. MKBHD audience mention: 12 million followers - The conversation also references Brownlee’s large following in discussing his influence.

Pivotal Quotes: "I think he wants to use kind of their massive distribution to kill ChatGPT in the cradle if he can, so to speak." — Alex Heath: Describing Zuckerberg’s strategy for Meta AI across Facebook, WhatsApp, and Instagram. "Reviews don't kill products. Bad products kill products." — Alex Heath: Defending MKBHD’s negative reviews of Humane and Fisker. "This is a business and not a place to act in a way that disrupts coworkers or makes them feel unsafe." — Sundar Pichai: From his memo to Google employees following protests and firings.

Implications: AI winners may be the companies with the best distribution and product integration, not necessarily the best standalone models. Google is becoming less tolerant of internal activism. Reviewers can remain blunt without being blamed for weak products.

🔓 Sign Up for Unlimited Episode Search

About Big Technology Podcast

The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Alex Kantrowitz, a Silicon Valley journalist who's interviewed the world's top tech CEOs — from Mark Zuckerberg to Larry Ellison — is the host.

View all episodes from Big Technology Podcast