davidrd123 commited on
Commit
ad4e7b1
1 Parent(s): a8d5885

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +46 -0
  2. config.yaml +104 -0
  3. lora.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: flux-1-dev-non-commercial-license
4
+ license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
5
+ language:
6
+ - en
7
+ tags:
8
+ - flux
9
+ - diffusers
10
+ - lora
11
+ - replicate
12
+ base_model: "black-forest-labs/FLUX.1-dev"
13
+ pipeline_tag: text-to-image
14
+ # widget:
15
+ # - text: >-
16
+ # prompt
17
+ # output:
18
+ # url: https://...
19
+ instance_prompt: MRSDN
20
+ ---
21
+
22
+ # Flux Marsden Hartley Lora Replicate
23
+
24
+ <!-- <Gallery /> -->
25
+
26
+ Trained on Replicate using:
27
+
28
+ https://replicate.com/ostris/flux-dev-lora-trainer/train
29
+
30
+
31
+ ## Trigger words
32
+ You should use `MRSDN` to trigger the image generation.
33
+
34
+
35
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
36
+
37
+ ```py
38
+ from diffusers import AutoPipelineForText2Image
39
+ import torch
40
+
41
+ pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
42
+ pipeline.load_lora_weights('davidrd123/Flux-Marsden-Hartley-LoRA-Replicate', weight_name='lora.safetensors')
43
+ image = pipeline('your prompt').images[0]
44
+ ```
45
+
46
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
config.yaml ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ job: custom_job
2
+ config:
3
+ name: flux_train_replicate
4
+ process:
5
+ - type: custom_sd_trainer
6
+ training_folder: output
7
+ device: cuda:0
8
+ trigger_word: MRSDN
9
+ network:
10
+ type: lora
11
+ linear: 16
12
+ linear_alpha: 16
13
+ save:
14
+ dtype: float16
15
+ save_every: 100
16
+ max_step_saves_to_keep: 1
17
+ datasets:
18
+ - folder_path: input_images
19
+ caption_ext: txt
20
+ caption_dropout_rate: 0.1
21
+ shuffle_tokens: false
22
+ cache_latents_to_disk: false
23
+ cache_latents: true
24
+ resolution:
25
+ - 512
26
+ - 768
27
+ - 1024
28
+ train:
29
+ batch_size: 1
30
+ steps: 2000
31
+ gradient_accumulation_steps: 1
32
+ train_unet: true
33
+ train_text_encoder: false
34
+ content_or_style: balanced
35
+ gradient_checkpointing: true
36
+ noise_scheduler: flowmatch
37
+ optimizer: adamw8bit
38
+ lr: 0.0004
39
+ ema_config:
40
+ use_ema: true
41
+ ema_decay: 0.99
42
+ dtype: bf16
43
+ model:
44
+ name_or_path: FLUX.1-dev
45
+ is_flux: true
46
+ quantize: true
47
+ sample:
48
+ sampler: flowmatch
49
+ sample_every: 100
50
+ width: 1024
51
+ height: 1024
52
+ prompts:
53
+ - In the style of MRSDN, A rocky Maine coastline with bold, geometric shapes
54
+ representing cliffs and waves. Strong colors and simplified forms dominate
55
+ the composition.
56
+ - ''
57
+ - In the style of MRSDN, An abstract composition inspired by Berlin's urban
58
+ life. Fragmented shapes, numbers, and symbols arranged in a Cubist-influenced
59
+ style.
60
+ - ''
61
+ - In the style of MRSDN, A still life of flowers in a vase, rendered with thick
62
+ brushstrokes and vibrant, non-naturalistic colors. Simplified forms show Cubist
63
+ influence.
64
+ - ''
65
+ - In the style of MRSDN, A stark New Mexico landscape with stylized mountains
66
+ and desert flora. Bold outlines and earthy colors capture the essence of the
67
+ Southwest.
68
+ - ''
69
+ - In the style of MRSDN, A portrait of a WWI German soldier, composed of geometric
70
+ shapes and military symbols. Strong, emotive use of color and form.
71
+ - ''
72
+ - In the style of MRSDN, Mount Katahdin in Maine, depicted with sharp angles
73
+ and bold colors. The landscape is reduced to its essential forms, emphasizing
74
+ its rugged nature.
75
+ - ''
76
+ - In the style of MRSDN, Modern New York skyscrapers rendered in Hartley's style.
77
+ Geometric shapes and bold colors create a dynamic urban composition.
78
+ - ''
79
+ - In the style of MRSDN, An orbiting space station viewed through a Modernist
80
+ lens. Fragmented forms and symbolic elements represent the futuristic structure.
81
+ - ''
82
+ - In the style of MRSDN, An electric car charging station, depicted with Cubist-inspired
83
+ fragmentation. Bold colors and geometric shapes represent energy and technology.
84
+ - ''
85
+ - In the style of MRSDN, A composition of social media icons and symbols, arranged
86
+ in a Modernist style reminiscent of Hartley's German officer paintings.
87
+ - ''
88
+ - In the style of MRSDN, An abstract representation of climate change, using
89
+ Hartley's bold style to depict melting ice caps, rising seas, and changing
90
+ weather patterns.
91
+ - ''
92
+ - In the style of MRSDN, A person wearing a VR headset, surrounded by fragmented,
93
+ Cubist-inspired virtual elements. Bold colors and geometric forms dominate
94
+ the composition.
95
+ - ''
96
+ - In the style of MRSDN, hamster
97
+ neg: ''
98
+ seed: 42
99
+ walk_seed: true
100
+ guidance_scale: 3.5
101
+ sample_steps: 28
102
+ meta:
103
+ name: flux_train_replicate
104
+ version: '1.0'
lora.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:756e0236848e5b69c7e19cf1075f4dfd82db8d86567dad77615788861c0797d7
3
+ size 171969416