Unit 12. Generative Models Structure

[hwaseem04]

INTRODUCTION [not assigned] / @jere

• What are generative vision models and how do they differ from other models?
• Different types of generative models/tasks?
• Prerequisites and resources to help

GANS & VAEs

• VAEs theory @sarthak247
• Idea behind GANs, generator and discriminator (DCGAN as the main implementation) @sarthak247
• Simple explanation, showcase and external resources:
  • StyleGAN @hwaseem04
  • CycleGAN @charchit7
  • VQGAN @sarthak247

Diffusion models

• Theory of diffusion models and how they differ from GANs (limitations of GANs) @hwaseem04
• Evolution/ what made it work diffusion models DDPM, latent diffusion @hwaseem04
• Using stable diffusion @charchit7
  • Basic structure of SD
  • How to use txt2img, img2img, inpainting
• Simple explanation, showcase and external resources @mattmdjaga
  • Dreambooth
  • LoRA, show how to use, link to fine-tuning yourself
  • ControlNet, show how to use

Practical Application & Challenges @hwaseem04

• Real-time Constraints
• Bias concerns and Privacy Concerns
• Super resolution [not assigned]

[hwaseem04]

@lunarflu @merveenoyan would like to hear feedback from you