Stable Diffusion generates images from text descriptions
Stable Diffusion
Stable Diffusion generates images from text descriptions
The model was developed by researchers from the CompVis Group at LMU Munich and Runway, with computational support from Stability AI. This collaboration resulted in a publicly accessible model that can run on consumer hardware with modest GPU capabilities. This accessibility marks a significant advancement over previous proprietary models like DALL-E and Midjourney.
Example
A user inputs "a sunset over the mountains" and receives an image of a beautiful sunset scene with mountains in the background.
Remember this
Stable Diffusion's ability to generate images from text descriptions can significantly enhance creative processes and applications in various fields.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
Related concepts
the reverse process learns: p_θ(x_{t-1}|x_t)
Ancestral reconstruction extrapolates characteristics back in time
Langevin dynamics does: adds noise to gradient descent to sample from a distribution
Langevin dynamics uses stochastic differential equations
Contrastive Language–Image Pre-training
CLIP embeds images and text into a shared space using contrastive learning
Large language model
LLMs can generate, summarize, translate, and analyze text in many contexts
weight tying does in language models: shares embedding and output projection matrices
Ever wonder how machines understand the sequence of words in a sentence?
DDIM does: deterministic sampling for faster generation with fewer steps
DDIM accelerates image generation by deterministically sampling intermediate steps
Swipe through 100 ML concepts daily
Open Pocket Polymath