Practical AI
Practical AI

Generating product imagery at Shopify

Shopify recently released a Hugging Face space demonstrating very impressive results for replacing background scenes in product imagery. In this episode, we hear the backstory technical details about this work from Shopify’s Russ Maschmeyer. Along the way we discuss how to come up with clever AI sol

Featured Speakers

Russ Mashmeier Guest

Topics Discussed

Episode Summary

Executive Summary: Shopify’s Russ Mashmeier explains how AI is being used to reduce merchants’ routine work, from generating product descriptions and marketing copy to creating product imagery. He describes Shopify Magic and a rapid-prototyping approach, then details an open-source Stable Diffusion XL workflow that changes image backgrounds while preserving product pixels and improving visual grounding. He sees personalized, more helpful online shopping as a major future opportunity.

Main Topics: AI’s role in e-commerce and merchant productivity: Mashmeier frames generative AI as a way to make entrepreneurship more accessible by reducing routine work and helping merchants learn and execute tasks more quickly. Shopify prioritizes merchant needs rather than adopting AI for its own sake. Shopify Magic tools: Shopify’s free AI-enabled features appear within existing admin workflows. Examples include generating product descriptions from product details, selecting a tone, and drafting blog content and marketing email subject lines. AI-generated product photography: The team aims to help merchants reuse existing product images by generating new settings around them. This can make modest or at-home photography more useful for storefronts, marketing, and seasonal merchandising. Preserving products and solving visual grounding: Early image-generation approaches often made the product look disconnected from its new background. Shopify’s workflow preserves the original product pixels, gives the model depth and limited shadow or reflection context, and composites the preserved product into the generated scene. Open-source tools and rapid experimentation: Shopify’s team used ComfyUI, a node-based open-source interface, to rapidly assemble and test image-processing pipelines, then shared a Stable Diffusion XL-based workflow on Hugging Face. The team evaluates new capabilities in short exploratory cycles. Future of personalized commerce: Mashmeier anticipates AI-enabled shopping experiences that recognize shoppers’ preferences, help them discover relevant products, and potentially let them visualize themselves wearing items online.

Key Arguments: AI is most useful when it removes merchant toil and returns time for higher-value work, rather than simply adding features. Product-description writing was an early fit because it is time-consuming for merchants and can be generated from basic product context. AI features should be integrated into the workflows merchants already use, with controls such as tone selection and the ability to review or adjust generated content. Image generation can help merchants create more varied and compelling product media without requiring repeated photo shoots, but preserving product accuracy is essential because logos and product details may be altered by generative models. A practical intermediate step toward fully personalized product-image generation is to preserve the product image and use AI to create a new environment around it. Visual quality depends on grounding cues, not just a good background prompt. Supplying product identity, placement context, and depth information helps generate plausible shadows, reflections, and camera relationships. Teams can make progress in an immature field through fast, visual experimentation. ComfyUI enabled Shopify’s team to rewire workflows, observe unexpected results, and iterate toward a useful solution without training a new model. AI could bring some advantages of in-person retail—recognition, tailored recommendations, and product guidance—to online shopping.

Data Points: Advent of Gen AI hackathon duration: 7 days - The introductory announcement describes a free generative AI hackathon organized by Intel’s Liftoff program and Prediction Guard. Product-description writing time: About an hour and a half - Mashmeier contrasts the time a merchant may spend crafting a product description with generating one in seconds using Shopify’s tool. Magic Labs experimentation cycle: 3 weeks - The team uses short cycles to select a technology or question, prototype, and produce a result that tests whether an idea is viable. Product-description feature development: About 2 months - Mashmeier says the feature moved from concept and team assembly to launch at Shopify’s Winter Editions in roughly two months. Shopify tenure of the co-host’s wife’s business: About 9 of 10 years - Daniel says his wife’s e-commerce business has used Shopify for most of its roughly ten-year existence; this is personal context rather than a Shopify-wide statistic.

Pivotal Quotes: "We look for toil that merchants do." — Russ Mashmeier: Summarizes Shopify’s approach to choosing AI use cases: target necessary but undesirable work merchants would rather avoid. "The pixels of the product and the pixels of the environment aren't speaking to each other." — Russ Mashmeier: Describes why early background-generation tools made product images look artificial and disconnected. "I'm really excited about a future where AI helps bring these kinds of personalized, one-to-one, customized shopping experiences to merchants and helps them bring that to their shoppers." — Russ Mashmeier: Expresses his view of AI’s longer-term potential to make online shopping more personal and assistive.

Implications: For merchants, near-term AI value lies in integrated tools that reduce repetitive work while preserving human control and product accuracy. For AI teams, the episode highlights rapid open-source experimentation as a way to solve practical gaps. Better personalization could make online commerce feel more like attentive in-person retail.

🔓 Sign Up for Unlimited Episode Search

About Practical AI

View all episodes from Practical AI