Can we record our senses?

Episode Summary

Executive Summary: The episode explores whether media can move beyond sight and sound to include smell and touch. It traces early scented cinema experiments, profiles modern smell- and haptics-based technologies, and concludes that while immersive sensory media is advancing, faithfully recording and replaying complex real-world sensations remains difficult.

Main Topics: Why media only uses sight and sound (Priority: 5/5): The host introduces listener Arvind Kulkarni's question about why devices can record video and audio but not smell or touch, framing the episode around multisensory media and future interaction design. History of scented cinema (Priority: 5/5): Experts recount early 20th-century attempts to add smell to films, including improvised scent systems and the later 'Smell-O-Vision' and 'Aromarama' experiments, showing that interest in smell track technology is longstanding. Modern smell-track technology (Priority: 5/5): Raul Polcar demonstrates a contemporary home-based smell system that synchronizes scent emissions with film scenes, illustrating that scent-enhanced viewing is now technically feasible in limited settings. Why smell is hard to standardize (Priority: 4/5): The discussion explains that odors are chemically complex, unpleasant smells linger, and user reactions vary, making reliable capture and reproduction far harder than adding a simple visual or audio track. Haptics and teleoperation (Priority: 5/5): Catherine Kuchenbecker explains haptic feedback, showing how touch technology supports VR, surgical robotics, rescue robotics, and texture reproduction through tools like styluses and sensors. Limits of recording and replaying touch (Priority: 4/5): The episode distinguishes between limited haptic capture of specific interactions and fully reproducing embodied experiences like walking on ice or feeling wind, which remains far more difficult.

Key Arguments: Smell and touch can deepen immersion because they trigger emotion, memory, and a stronger sense of realism. Scented cinema has existed for over a century, but early systems were commercially weak and technically inconsistent. Modern smell systems can work well for carefully chosen scenes, especially when scent is integrated with narrative and mood. Bad smells are harder to use effectively because they persist longer and can ruin the viewing experience. Touch is not one simple sense; it involves many receptors and sensations, making digital capture and playback much more complex. Current haptics are useful for VR and teleoperation, but true replay of whole-body tactile experiences is still beyond reach.

Data Points: Time span of film scent experimentation: Almost as long as movies themselves - Jazz Brooks notes the film industry has experimented with scent nearly since cinema began. Year of earliest cited scent experiment: 1910 - Roxy Rothofel's early scented-film experiment using rose perfume and fans. Number of scents in original Smell-O-Vision: 30 - Hans Laub's smell machine reportedly pumped 30 scents to individual seats. Year Aromarama premiered: 1959 - The competing scent-film system premiered just before Smell-O-Vision. Year Smell-O-Vision premiered: 1960 - Smell-O-Vision debuted with the film 'Scent of Mystery'. Number of scents used in the 2015/2016 recreation: 16 - Tammy Bernstock and Jazz Brooks recreated the experience with fewer scents than the original. Years of recreation screenings: 2015-2016 - Recreated screenings were staged in the UK, Denmark, and Hollywood. Size of material database: 100 different material samples - Catherine Kuchenbecker's synthetic fabric library for haptic texture reproduction. Current frequency of consumer units: Units in five continents - Raul Polcar says Olorama systems are now deployed across five continents.

Pivotal Quotes: "We have video cameras and we have audio recorders, but why don't we have smell recorders and like touch reproducers?" — Arvind Kulkarni: The listener's question that drives the entire episode. "Smell just impacts you so strongly, captures all of your attention, evokes things like memories and gut reactions." — Jazz Brooks: Explanation of why smell is a powerful sensory target for media technology. "The problem is simply much harder." — Catherine Kuchenbecker: Her summary of why touch is much harder to capture and reproduce than sight and sound.

Implications: Smell and touch media are advancing, but only in constrained, curated forms. Expect more immersive films, VR, and teleoperation tools first, while full sensory recording/playback remains a long-term challenge.