Update README.md

README.md

@@ -117,7 +117,13 @@ widget:
 
 This is a LoRA derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
 
+Two subjects were trained in, a character named Julia (AI) and a real person named River Phoenix.
 
+Empirically, training two subjects in simultaneously kept the model from collapsing, though they don't train evenly - River Phoenix took longer than "Julia", possibly due to the synthetic nature of the data.
+
+The photos of "Julia" came from Flux Pro. River Phoenix images were pulled from Google Image Search, with a focus on high resolution, high quality samples.
+
+No captions were used during training, only instance prompts `julia` and `river phoenix`.
 
 The main validation prompt used during training was:
 
@@ -194,13 +200,12 @@ import torch
 from diffusers import DiffusionPipeline
 
 model_id = 'black-forest-labs/FLUX.1-dev'
-adapter_id = 'flux-dreambooth-lora'
+adapter_id = 'ptx0/flux-dreambooth-lora-r16-dev'
 pipeline = DiffusionPipeline.from_pretrained(model_id)
 pipeline.load_lora_weights(adapter_id)
 
 prompt = "julie, in photograph style"
 
-
 pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
 image = pipeline(
     prompt=prompt,
@@ -213,3 +218,62 @@ image = pipeline(
 image.save("output.png", format="PNG")
 ```
 
+
+## SimpleTuner Config
+
+The configuration used to train this model:
+
+```bash
+export MODEL_TYPE='lora'
+export TRAINING_SEED=420420420
+
+export CHECKPOINTING_STEPS=500
+export CHECKPOINTING_LIMIT=10
+
+export LEARNING_RATE=1e-4
+
+export FLUX=true
+export MODEL_NAME="black-forest-labs/FLUX.1-dev"
+
+export VALIDATION_SEED=420420420
+export VALIDATION_PROMPT="julie, in photograph style"
+export VALIDATION_NEGATIVE_PROMPT="blurry, cropped, ugly"
+
+# How frequently we will save and run a pipeline for validations.
+export VALIDATION_STEPS=500
+
+# Validation image settings.
+export VALIDATION_GUIDANCE=3.0
+export VALIDATION_GUIDANCE_REAL=3.0
+export VALIDATION_NUM_INFERENCE_STEPS=28
+export VALIDATION_GUIDANCE_RESCALE=0
+export VALIDATION_RESOLUTION=1024x1024
+
+export ALLOW_TF32=true
+export PURE_BF16=true
+
+export CAPTION_DROPOUT_PROBABILITY=0
+
+export MAX_NUM_STEPS=0
+export NUM_EPOCHS=1000
+
+export OPTIMIZER="adamw_bf16"
+export LR_SCHEDULE="constant"
+export LR_WARMUP_STEPS=500
+
+export TRAIN_BATCH_SIZE=1
+
+export RESOLUTION=512
+export RESOLUTION_TYPE=pixel
+
+export GRADIENT_ACCUMULATION_STEPS=2
+export MIXED_PRECISION="bf16"
+export TRAINING_DYNAMO_BACKEND='inductor'
+
+export USE_XFORMERS=false
+export USE_GRADIENT_CHECKPOINTING=true
+export VAE_BATCH_SIZE=8
+export TRAINER_EXTRA_ARGS="--aspect_bucket_worker_count=48 --lora_rank=16 --lora_alpha=16 --max_grad_norm=1.0 --gradient_precision=fp32 --base_model_default_dtype=bf16 --lora_init_type=default --flux_lora_target=all+ffs --user_prompt_library=user_prompt_library.json  --webhook_config=webhooks.json --compress_disk_cache"
+
+export USE_EMA=false
+```