Speaking of Psychology
Speaking of Psychology

Multisensory perception: How sight, sound and touch shape what we taste, with Charles Spence, PhD

Why does seafood taste better at the beach? Why are so many snacks crunchy? Can the color of a room or the music in the background change the way we experience what we eat and drink? Charles Spence, PhD, head of the Crossmodal Research Laboratory at the University of Oxford, discusses the science of

Topics Discussed

Episode Summary

Executive Summary: The episode explores how taste is shaped by more than chemistry: vision, sound, touch, context, and emotion all influence what and how we eat. Dr. Charles Spence explains cross-modal perception, sonic seasoning, and multisensory design in food, packaging, and dining environments, showing how these effects can change enjoyment, consumption, virality, and even emotional responses.

Main Topics: Cross-modal vs. multisensory perception: Spence distinguishes cross-modal effects, where one sense influences another (like sound affecting brightness), from multisensory integration, where senses combine into one unified flavor experience. Why food is the ideal multisensory case: Eating engages sight, smell, taste, texture, sound, and oral touch simultaneously, making food an unusually rich example of how senses interact in everyday life. Sonic seasoning and the role of sound: Experiments with potato chips, wine, seafood, and music show that sounds can alter perceived crunchiness, freshness, sweetness, bitterness, and liking. Context, packaging, and environment shape flavor: Plate color, cutlery, lighting, room color, background music, and packaging all systematically change taste expectations and reported flavor. Emotional and immersive dining experiences: Real-world dining can evoke strong reactions such as crying, especially when multisensory cues, narrative meal structure, nostalgia, and bodily vibrations combine. Trends, social media, and AI in food: Visual distinctiveness drives viral food trends like Dubai chocolate; AI is increasingly used to generate culinary concepts and imagery, though human sense-checking remains essential. Future of culinary counterpoint: Spence is exploring whether dining could borrow from film music by using counterpoint and narrative tension rather than simple sensory matching.

Key Arguments: Taste is not determined by chemical composition alone; perception is built from multiple senses and the surrounding context. Sound can measurably change food experience, including perceived crunch, freshness, fruitiness, and liking. The brain uses sensory cues from eating to regulate intake, so distraction can increase consumption. Visual presentation and environmental cues can change taste expectations before the food is even eaten. Strong emotional reactions to food often depend on the whole experience, not just the dish itself. Social media rewards visually distinctive foods, which helps explain the rise of foods like Dubai chocolate and extreme taste challenges. AI is useful for generating food concepts and images, but culinary creativity still requires human judgment because AI cannot taste or smell.

Data Points: Participants in sonic chip study: 20 hungry undergraduates - Initial Pringles/crunch experiment conducted in Oxford soundproof booth Taste/liking improvement from enhanced crunch sound: About 15% - Enhancing the sound of chip crunch increased perceived crunchiness, freshness, and liking Wine tasting study participants: About 3,000 people - Large food-festival wine experiment in London Wine experiment lighting effects: About 15% - Red lighting increased perceived fruitiness by about 15% and green lighting brought out fresh acidic notes Eating with TV on: Up to 30% more food - Distracted eating while watching television can increase consumption Eating with mobile device: About 10% to 15% more - Phone/device distraction increases intake during meals Crying diners at Milan restaurant: About two-thirds - In the rice pudding course experiment, roughly two-thirds of diners cried when ultra-low-frequency vibrations were included Very low-frequency vibrations: 0 to 20 hertz - Sub-audible vibrations used to make diners more aware of their bodies Approximate meal length: 2.5 to 3 hours - The emotional journey of the multi-course dinner contributed to crying responses

Pivotal Quotes: "the sound of the food itself" — Dr. Charles Spence: Explaining why crunch and other food sounds matter as a forgotten flavor sense "Sound is a forgotten flavor sense. Sound's an ingredient the chef can use in the kitchen." — Heston Blumenthal: Reaction after experiencing the sonic chip research and its culinary implications "I think it's all about the eye appeal, the Instagrammability, not really anything to do with the taste or the texture." — Dr. Charles Spence: Explaining why Dubai chocolate and similar trends spread so quickly

Implications: Food design will increasingly blend psychology, sensory science, and media aesthetics. For listeners, this means eating more mindfully may improve health and enjoyment; for industry, packaging, AI imagery, and multisensory environments will become major tools for shaping demand.

🔓 Sign Up for Unlimited Episode Search

About Speaking of Psychology

View all episodes from Speaking of Psychology