jegwang commited on
Commit
55ab3b5
·
verified ·
1 Parent(s): 841d292

End of training

Browse files
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
3
+ library_name: diffusers
4
+ license: openrail++
5
+ tags:
6
+ - text-to-image
7
+ - text-to-image
8
+ - diffusers-training
9
+ - diffusers
10
+ - lora
11
+ - template:sd-lora
12
+ - stable-diffusion-xl
13
+ - stable-diffusion-xl-diffusers
14
+ instance_prompt: a photo of TOK dog
15
+ widget: []
16
+ ---
17
+
18
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
19
+ should probably proofread and complete it, then remove this comment. -->
20
+
21
+
22
+ # SDXL LoRA DreamBooth - jegwang/corgy_dog_LoRA
23
+
24
+ <Gallery />
25
+
26
+ ## Model description
27
+
28
+ These are jegwang/corgy_dog_LoRA LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
29
+
30
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/).
31
+
32
+ LoRA for the text encoder was enabled: False.
33
+
34
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
35
+
36
+ ## Trigger words
37
+
38
+ You should use a photo of TOK dog to trigger the image generation.
39
+
40
+ ## Download model
41
+
42
+ Weights for this model are available in Safetensors format.
43
+
44
+ [Download](jegwang/corgy_dog_LoRA/tree/main) them in the Files & versions tab.
45
+
46
+
47
+
48
+ ## Intended uses & limitations
49
+
50
+ #### How to use
51
+
52
+ ```python
53
+ # TODO: add an example code snippet for running this diffusion pipeline
54
+ ```
55
+
56
+ #### Limitations and bias
57
+
58
+ [TODO: provide examples of latent issues and potential remediations]
59
+
60
+ ## Training details
61
+
62
+ [TODO: describe the data used to train the model]
logs/dreambooth-lora-sd-xl/1729938819.271611/events.out.tfevents.1729938819.6d0ddb89d60e.5700.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7813eaf75b96cc681614ba7b54843dd278b01ed3383d2d80c8ab9afe342ada5
3
+ size 3295
logs/dreambooth-lora-sd-xl/1729938819.2735415/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: dog
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a photo of TOK dog
26
+ learning_rate: 0.0001
27
+ local_rank: -1
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 250
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: corgy_dog_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 1
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/1729938919.370141/events.out.tfevents.1729938919.6d0ddb89d60e.6455.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bf2ca8edf40b4bc07900667f44423d8b75cb75fa1eafe5c27e257b23dd51803
3
+ size 3295
logs/dreambooth-lora-sd-xl/1729938919.3719916/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: dog
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a photo of TOK dog
26
+ learning_rate: 0.0001
27
+ local_rank: -1
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 500
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: corgy_dog_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 8
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/1729938999.5154898/events.out.tfevents.1729938999.6d0ddb89d60e.6834.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc1ee584f31f958ad87a9fc0bf8b0e7b6572200f4a42e4ab3469a412d566722d
3
+ size 3295
logs/dreambooth-lora-sd-xl/1729938999.5174127/hparams.yml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ caption_column: prompt
9
+ center_crop: false
10
+ checkpointing_steps: 717
11
+ checkpoints_total_limit: null
12
+ class_data_dir: null
13
+ class_prompt: null
14
+ dataloader_num_workers: 0
15
+ dataset_config_name: null
16
+ dataset_name: dog
17
+ do_edm_style_training: false
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 3
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a photo of TOK dog
26
+ learning_rate: 0.0001
27
+ local_rank: -1
28
+ logging_dir: logs
29
+ lr_num_cycles: 1
30
+ lr_power: 1.0
31
+ lr_scheduler: constant
32
+ lr_warmup_steps: 0
33
+ max_grad_norm: 1.0
34
+ max_train_steps: 500
35
+ mixed_precision: fp16
36
+ num_class_images: 100
37
+ num_train_epochs: 500
38
+ num_validation_images: 4
39
+ optimizer: AdamW
40
+ output_dir: corgy_dog_LoRA
41
+ output_kohya_format: false
42
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
43
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
44
+ prior_generation_precision: null
45
+ prior_loss_weight: 1.0
46
+ prodigy_beta3: null
47
+ prodigy_decouple: true
48
+ prodigy_safeguard_warmup: true
49
+ prodigy_use_bias_correction: true
50
+ push_to_hub: false
51
+ random_flip: false
52
+ rank: 4
53
+ repeats: 1
54
+ report_to: tensorboard
55
+ resolution: 1024
56
+ resume_from_checkpoint: null
57
+ revision: null
58
+ sample_batch_size: 4
59
+ scale_lr: false
60
+ seed: 0
61
+ snr_gamma: 5.0
62
+ text_encoder_lr: 5.0e-06
63
+ train_batch_size: 16
64
+ train_text_encoder: false
65
+ use_8bit_adam: true
66
+ use_dora: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/events.out.tfevents.1729938819.6d0ddb89d60e.5700.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e22559405450736d5e96c8032229688b9af6c67cc43ec1c9f79bb256f175abc
3
+ size 4262
logs/dreambooth-lora-sd-xl/events.out.tfevents.1729938919.6d0ddb89d60e.6455.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d30a916c19070f98b98195418e2482884a0ed397a7f63ac9b7515ec97254d84e
3
+ size 2056
logs/dreambooth-lora-sd-xl/events.out.tfevents.1729938999.6d0ddb89d60e.6834.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d27ef741084ae12d0bedf9fa59bae0f7211cf284388ff219a0c9087b3b1725b
3
+ size 41834
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6de9d6b72b5c1c0d1a3a45052fab2360fee330da192bf517e62b7468390f6c62
3
+ size 23390424