Model card auto-generated by SimpleTuner

README.md

@@ -0,0 +1,184 @@
+---
+license: other
+base_model: "black-forest-labs/FLUX.1-dev"
+tags:
+  - flux
+  - flux-diffusers
+  - text-to-image
+  - diffusers
+  - simpletuner
+  - safe-for-work
+  - lora
+  - template:sd-lora
+  - lycoris
+inference: true
+widget:
+- text: 'unconditional (blank prompt)'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_0_0.png
+- text: 'A scene from One Piece. Nami stands at the edge of a cliff, wind blowing through her hair, with the ocean far below. She''s wearing a purple tank top and white skirt, her eyes full of determination. Sanji Vinsmoke is behind her, looking away, leaning on a tree with a cigarette in hand, dressed in his usual black suit. The setting sun casts a golden glow over the rocky terrain and crashing waves below.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_1_0.png
+- text: 'A scene from Jujutsu Kaisen. Maki Zenin is in the middle of a high-stakes battle, leaping forward with her weapon raised. Her glasses reflect the light of an explosion behind her. Beside her, the young male character with messy black hair stumbles, struggling to stay on his feet, his white jacket dirtied from the ongoing fight. The background shows a shattered wooden dojo, with debris scattered all around.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_2_0.png
+- text: 'A scene from Demon Slayer. Muzan Kibutsuji is standing in front of a large chalkboard filled with cryptic equations and diagrams. He holds a piece of chalk in one hand and a test tube in the other, his eyes gleaming with focus. The warm light from nearby candles flickers against the shelves of mysterious bottles and ingredients in his lab, giving the scene an eerie ambiance.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_3_0.png
+- text: 'A scene from Attack on Titan. Levi Ackerman is sitting under a tree, holding the piece of paper close to his face as he reads intently. His sword rests beside him, and the male character with short hair stands nearby, glancing over at the paper with a curious expression. The lush green forest around them is bathed in dappled sunlight, with the tall trees swaying gently in the breeze.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_4_0.png
+- text: 'A scene from My Hero Academia. Shoto Todoroki stands on a cliff overlooking a vast desert, his hand outstretched and half of the cliffside covered in ice. His dark blue outfit contrasts against the bright, sandy terrain. The harsh sunlight creates long shadows across the rocky landscape, adding to the intensity of the moment.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_5_0.png
+- text: 'A scene from Demon Slayer. Shoto Todoroki and Tanjiro Kamado stand side by side in a dense forest, both with serious expressions. Todoroki''s ice powers cover part of the forest floor, while Tanjiro holds his sword at the ready, his green and black checkered haori fluttering in the wind. Behind them, Mitsuri Kanroji smiles brightly, offering encouragement, her pink kimono glowing in the soft light filtering through the trees.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_6_0.png
+- text: 'A scene from Attack on Titan. Monkey D. Luffy is scaling the massive walls of Paradis Island with his stretchy arms, laughing as he pulls himself higher. Mikasa Ackerman watches in disbelief, her military uniform fluttering in the wind as she stands ready with her ODM gear. The sky is clear, with just a few clouds drifting above, and the vast landscape stretches out below them.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_7_0.png
+- text: 'A scene from My Hero Academia. Muzan Kibutsuji and Shoto Todoroki stand in the middle of a quiet street, the ground cracked from a recent battle. Muzan holds a test tube filled with a strange glowing liquid, while Todoroki''s hand is raised, ice forming around them in defensive spikes. The street is eerily still, with the remains of a destroyed building in the background, and the sun is setting, casting long shadows across the scene.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_8_0.png
+- text: 'A scene from One Piece. Levi Ackerman is on the deck of the Thousand Sunny, methodically cleaning his gear with a stern expression. Nami stands nearby, glancing over at him with a mix of curiosity and amusement, her arms crossed. The ship sails through calm waters under a bright blue sky, with a distant island just visible on the horizon.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_9_0.png
+- text: 'A scene from My Hero Academia. Ichigo Kurosaki stands in the middle of a training field, facing off against Shoto Todoroki. Ichigo holds his sword with a confident expression, while Todoroki''s left hand crackles with ice, and his right flares with flames. Muzan Kibutsuji watches from the sidelines, sitting casually on a bench with a sly smile, as if he''s observing a dangerous experiment. The sky above is cloudy, with faint rays of sunlight piercing through.'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_10_0.png
+---
+
+# anime-chars-simpletuner-lora-1
+
+This is a LyCORIS adapter derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
+
+
+No validation prompt was used during training.
+
+
+
+
+None
+
+
+## Validation settings
+- CFG: `3.5`
+- CFG Rescale: `0.0`
+- Steps: `20`
+- Sampler: `None`
+- Seed: `42`
+- Resolution: `1024x1024`
+
+Note: The validation settings are not necessarily the same as the [training settings](#training-settings).
+
+You can find some example images in the following gallery:
+
+
+<Gallery />
+
+The text encoder **was not** trained.
+You may reuse the base model text encoder for inference.
+
+
+## Training settings
+
+- Training epochs: 3
+- Training steps: 200
+- Learning rate: 0.001
+- Effective batch size: 192
+  - Micro-batch size: 48
+  - Gradient accumulation steps: 1
+  - Number of GPUs: 4
+- Prediction type: flow-matching
+- Rescaled betas zero SNR: False
+- Optimizer: adamw_bf16
+- Precision: Pure BF16
+- Quantised: Yes: int8-quanto
+- Xformers: Not used
+- LyCORIS Config:
+```json
+{
+    "algo": "lokr",
+    "multiplier": 1.0,
+    "linear_dim": 10000,
+    "linear_alpha": 1,
+    "factor": 12,
+    "apply_preset": {
+        "target_module": [
+            "Attention",
+            "FeedForward"
+        ],
+        "module_algo_map": {
+            "Attention": {
+                "factor": 12
+            },
+            "FeedForward": {
+                "factor": 6
+            }
+        }
+    }
+}
+```
+
+## Datasets
+
+### anime_char-512
+- Repeats: 2
+- Total number of images: ~3476
+- Total number of aspect buckets: 1
+- Resolution: 0.262144 megapixels
+- Cropped: False
+- Crop style: None
+- Crop aspect: None
+
+
+## Inference
+
+
+```python
+import torch
+from diffusers import DiffusionPipeline
+from lycoris import create_lycoris_from_weights
+
+model_id = 'black-forest-labs/FLUX.1-dev'
+adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
+lora_scale = 1.0
+wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
+wrapper.merge_to()
+
+prompt = "An astronaut is riding a horse through the jungles of Thailand."
+
+pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
+image = pipeline(
+    prompt=prompt,
+    num_inference_steps=20,
+    generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
+    width=1024,
+    height=1024,
+    guidance_scale=3.5,
+).images[0]
+image.save("output.png", format="PNG")
+```
+