E1111: Brewster Kahle on archiving the entire Internet, creating the Wayback Machine, protocols over platforms, microschools & more

Episode Summary

Executive Summary: Brewster Kahle frames the Internet Archive as a digital library for universal access to knowledge, preserving web pages, books, software, and media that would otherwise disappear. The conversation covers the fragility of the modern web, legal and rights-holder tensions, archiving software and old games, funding and infrastructure, and Kahle’s broader belief in open systems, micropayments, decentralized tech, and micro-schooling as experiments that improve society.

Main Topics: Internet Archive’s mission and the need for redundancy (Priority: 5/5): Kahle explains that the Archive exists to preserve all knowledge, because digital content is fragile, centralized, and often deleted or changed. He argues the web lacks the redundancy that books and libraries historically provided. Wayback Machine, web preservation, and journalism (Priority: 5/5): The Wayback Machine is described as a massive web collection used by journalists and the public to recover deleted or altered pages, especially important because many pages live only briefly before disappearing. Copyright, takedowns, and library ethics (Priority: 4/5): He discusses how the Archive handles rights-holder requests, public figures, and fair-use-like balancing, emphasizing that the institution acts as a nonprofit library rather than an adversarial platform. Archiving software, emulators, and retro games (Priority: 4/5): Kahle details how the Archive preserves old software and games through browser-based emulation, letting users run classic systems like IBM PCs or play Oregon Trail directly in the browser. Open protocols vs. platform silos (Priority: 4/5): He criticizes app ecosystems, social media black boxes, and ad-driven monopoly structures, arguing that protocols, open standards, and decentralized systems are healthier for the internet. Funding, scale, and sustainability of the Archive (Priority: 3/5): The Archive is funded by libraries, grants, and user donations, with Kahle emphasizing that it runs on a relatively modest budget for the value it provides and can be supported by recurring donations. Micro-schools and education experimentation (Priority: 4/5): Kahle argues that small-group, customized schooling can be more effective and even cheaper than conventional systems, based on his own experience teaching his child and examining school funding math.

Key Arguments: Digital content is far more fragile than paper; one website or platform can vanish, taking unique cultural records with it. Libraries and archives should provide multiple copies and long-term access, not rely on publishers, platforms, or single URLs. The Internet Archive is not trying to replace publishing or monetize content; its intent is preservation and public access, which matters in fair-use and takedown disputes. Browser-based emulation can preserve software history and make old computing systems usable again without requiring original hardware. Open standards and decentralized systems create healthier ecosystems than app-store silos and ad networks, which concentrate power. The ad-based model pushes media toward winner-takes-all outcomes and weakens independent publishing. Small-scale education can dramatically improve engagement and outcomes by matching teachers to students more closely, and can be cost-competitive with current systems. Experimentation is preferable to ideological rigidity in both education and technology policy.

Data Points: Internet Archive data size: 60 petabytes - Kahle says the Archive stores about 60 petabytes of data. Web page lifespan: 100 days - He says the average life of a web page is about 100 days before it changes or is deleted. Archive usage: Hundreds of thousands of people a day - He describes the Wayback Machine as being used daily at very large scale. Annual budget: About $20 million a year - Kahle gives a rough yearly operating budget for the Internet Archive. Staff size: Over 100 people - He says the organization has more than 100 employees. Funding from libraries and museums: About 600 organizations - He says roughly 600 libraries, museums, and organizations pay for archive services. Library comparison: About $170 million a year - He compares the Archive’s budget to the San Francisco Public Library. Public library comparison: About the Alameda Public Library - He characterizes the Archive’s budget as similar to Alameda Public Library scale. Book publishing revenue from libraries: 20% - He states that libraries account for about 20% of book publishing revenues for major trade publishers. Classroom ratio under his model: 1 to 4 students - He argues that reallocating education spending could support very small classes. Current public school spending: $10,000 per kid per year - He cites average U.S. public school spending per student. New York public school spending: $22,000 per kid per year - He cites New York as a higher-cost example.

Pivotal Quotes: "The idea of the Internet Archive is to build universal access to all knowledge." — Brewster Kahle: He defines the Archive’s core mission at the start of the interview. "One's almost always the wrong answer. We're going to need multiple copies." — Brewster Kahle: He explains why web content needs redundancy, unlike a single website or URL. "Apps are the enemy." — Brewster Kahle: He contrasts open web protocols with closed app ecosystems and platform silos.

Implications: The episode argues for preserving digital culture through nonprofit infrastructure, open standards, and decentralized access. For listeners, it highlights why archiving, funding, and experimentation matter for democracy, education, and the long-term health of the internet.