Trained for 4 epochs and 4500 steps.

Trained with datasets ['text-embeds-pixart-nofilter', 'photo-concept-bucket']
Learning rate 4e-07, batch size 32, and 2 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'linspace' timestep spacing.
Base model: terminusresearch/pixart-900m-1024
VAE: madebyollin/sdxl-vae-fp16-fix

README.md

@@ -1005,8 +1005,8 @@ You may reuse the base model text encoder for inference.
 
 ## Training settings
 
-- Training epochs: 3
-- Training steps: 4000
+- Training epochs: 4
+- Training steps: 4500
 - Learning rate: 4e-07
 - Effective batch size: 512
   - Micro-batch size: 32

optimizer.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d3f2a207e9d14a0fdf4a0a7145ebb9755a5cafe679787f1614dfe79ff3413514
+oid sha256:58f94e3fc5c4c3bfa6c3ec918b0ae980070f88df16331e6c94c85fc3c941968b
 size 5451415117

random_states_0.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e7bd4628d8a964d3f04e0fcb113e90248752b7e241a765b3bdb1f93f14da0fe9
-size 16100
+oid sha256:5f1e9e93b6d752fb9ed18b629ee819f77d3a63e6ff4410278bc8c59b1f7e3ede
+size 16036

scheduler.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d54f64f68660d822e560095ef18c71568b1d07fc2e99f70252173d5b305e6cb6
+oid sha256:a7968b8174f8d421a4a64525b8a2fbe0baabe3a7ad74b8d647a0c4aa16e0dbcf
 size 1000

training_state-photo-concept-bucket.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:df90f1ee82d73418b70af1126a8f49e0a53fbb8c20218f5fd65d2d1bddf56f2a
-size 7561740
+oid sha256:4b1828a96431c822cca4d9e5921885d784f45b1fc8435d7675524eed76f3729b
+size 4960101

training_state.json

@@ -1 +1 @@
-{"global_step": 4000, "epoch_step": 724, "epoch": 4, "exhausted_backends": [], "repeats": {"photo-concept-bucket": 0}}
+{"global_step": 4500, "epoch_step": 132, "epoch": 5, "exhausted_backends": [], "repeats": {"photo-concept-bucket": 0}}

transformer/diffusion_pytorch_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dd7bcb5bc3bb39c5a9afd9bb2e50dfccdb07e00d95f4ea2066f9b9db52446908
+oid sha256:4f8ef65a630c6493d65aef9ad59f4839077c507ff634a725ee2fc21df9dea909
 size 1816969728