History

Patrick Esser 1090550220 v3 pretraining scripts and config		2022-07-14 21:43:13 +00:00
..
resume_512	slurmy	2022-07-09 22:08:16 +00:00
resume_512_improvedaesthetic	more launch scripts	2022-07-09 22:10:20 +00:00
resume_768_hr	more launch scripts	2022-07-09 22:10:20 +00:00
v3_pretraining	v3 pretraining scripts and config	2022-07-14 21:43:13 +00:00
README.md	ready to slurm	2022-07-06 22:52:52 +00:00

Example

Resume f8 @ 512 on Laion-HR

sbatch scripts/slurm/resume_512/sbatch.sh

Reuse

To reuse this as a template, copy sbatch.sh and launcher.sh somewhere. In sbatch.sh, adjust the lines

#SBATCH --job-name=stable-diffusion-512cont
#SBATCH --nodes=24

and the path to your launcher.sh in the last line,

srun bash /fsx/stable-diffusion/stable-diffusion/scripts/slurm/resume_512/launcher.sh

In launcher.sh, adjust CONFIG and EXTRA. Maybe give it a test run with debug flags uncommented and a reduced number of nodes.