Diffusion Model

Full definition

Diffusion models train by adding Gaussian noise to data over many steps, then learning to predict the noise so the process can be reversed. At inference time, the model starts from pure noise and denoises step-by-step, optionally conditioned on a text prompt. Stable Diffusion, DALL-E 3, Midjourney, and Sora are all diffusion-based. Diffusion has largely replaced GANs (generative adversarial networks) for high-quality image synthesis since 2021.

Why it matters

Diffusion models put high-quality image and video generation in the hands of marketing, design, and creative teams. They also create new governance questions — copyright, deepfakes, brand safety — that legal and risk teams now own at the same level as data privacy.

Example

A media company uses a diffusion model to produce 50 hero-image variants for a campaign in an afternoon, replacing what was previously a $40,000 stock-photo and editing budget per quarter.

Related terms

• Generative AI
  Generative AI is a class of AI systems that produce new content — text, images, code, audio, or video — by learning the distribution of their training data and sampling from it, rather than classifying or predicting from existing inputs.
• Foundation Model
  A foundation model is a large model trained on broad data at scale — typically self-supervised — that can be adapted to many downstream tasks via prompting, fine-tuning, or retrieval, instead of being trained task-by-task.
• Multimodal Model
  A multimodal model is an AI model that natively understands or generates more than one type of input — typically text plus images, audio, or video — within a single network rather than via separate task-specific models.
• Hallucination
  An AI hallucination is when a language or generative model produces content that is plausible-sounding but factually incorrect, fabricated, or unfaithful to its sources — the single biggest failure mode of LLMs in regulated and high-stakes domains.