DDPM, Secure Diffusion, DALL·E-2, Imagen, Kandinsky 2, SDEdit, ControlNet, InstructPix2Pix, and extra
Embracing the ever-growing curiosity in Generative AI, together with picture era, many wonderful assets are beginning to turn out to be obtainable, a few of which I’ll spotlight beneath. Nonetheless, primarily based on my expertise, progressing past foundational programs calls for vital effort, as assets on superior matters turn out to be extra scattered.
On this article, we’ll checklist the most well-liked diffusion fashions from the Hugging Face Diffusers library, which is the first software for using this know-how. We’ll present temporary explanations of those fashions, examine them, and description their strengths and weaknesses.
The construction of this text is as follows: we’ll begin by reviewing a couple of worthwhile assets for individuals who are simply starting to check diffusion fashions. Afterward, we’ll present a short rationalization of the HuggingFace pipelines. Lastly, we’ll delve deep into every pipeline listed within the Popular Tasks & Pipelines part of the Diffusers GitHub repository.
