Home

Train a VAE or DALLE with your own dataset.

• Train in Colab

• https://github.com/lucidrains/DALLE-pytorch/wiki/Train-with-your-Own-Dataset

Train with multiple GPUS and/or multiple distributed nodes.

https://github.com/lucidrains/DALLE-pytorch/wiki/Multi-GPU-and-Multi-Node

(Experimental) Train with Deepspeed-ZeRO-Infinity

Train on vast.ai.

https://github.com/lucidrains/DALLE-pytorch/wiki/Vast.ai-Sparse-Attention

Attention Types

https://github.com/lucidrains/DALLE-pytorch/wiki/Attention-Layers

Citations

https://github.com/lucidrains/DALLE-pytorch/wiki/Citations