renderartist commited on
Commit
20bf6f2
0 Parent(s):

initial commit

Browse files
Files changed (2) hide show
  1. .gitattributes +55 -0
  2. README.md +108 -0
.gitattributes ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.lz4 filter=lfs diff=lfs merge=lfs -text
12
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
13
+ *.model filter=lfs diff=lfs merge=lfs -text
14
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
15
+ *.npy filter=lfs diff=lfs merge=lfs -text
16
+ *.npz filter=lfs diff=lfs merge=lfs -text
17
+ *.onnx filter=lfs diff=lfs merge=lfs -text
18
+ *.ot filter=lfs diff=lfs merge=lfs -text
19
+ *.parquet filter=lfs diff=lfs merge=lfs -text
20
+ *.pb filter=lfs diff=lfs merge=lfs -text
21
+ *.pickle filter=lfs diff=lfs merge=lfs -text
22
+ *.pkl filter=lfs diff=lfs merge=lfs -text
23
+ *.pt filter=lfs diff=lfs merge=lfs -text
24
+ *.pth filter=lfs diff=lfs merge=lfs -text
25
+ *.rar filter=lfs diff=lfs merge=lfs -text
26
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
27
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
29
+ *.tar filter=lfs diff=lfs merge=lfs -text
30
+ *.tflite filter=lfs diff=lfs merge=lfs -text
31
+ *.tgz filter=lfs diff=lfs merge=lfs -text
32
+ *.wasm filter=lfs diff=lfs merge=lfs -text
33
+ *.xz filter=lfs diff=lfs merge=lfs -text
34
+ *.zip filter=lfs diff=lfs merge=lfs -text
35
+ *.zst filter=lfs diff=lfs merge=lfs -text
36
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
37
+ # Audio files - uncompressed
38
+ *.pcm filter=lfs diff=lfs merge=lfs -text
39
+ *.sam filter=lfs diff=lfs merge=lfs -text
40
+ *.raw filter=lfs diff=lfs merge=lfs -text
41
+ # Audio files - compressed
42
+ *.aac filter=lfs diff=lfs merge=lfs -text
43
+ *.flac filter=lfs diff=lfs merge=lfs -text
44
+ *.mp3 filter=lfs diff=lfs merge=lfs -text
45
+ *.ogg filter=lfs diff=lfs merge=lfs -text
46
+ *.wav filter=lfs diff=lfs merge=lfs -text
47
+ # Image files - uncompressed
48
+ *.bmp filter=lfs diff=lfs merge=lfs -text
49
+ *.gif filter=lfs diff=lfs merge=lfs -text
50
+ *.png filter=lfs diff=lfs merge=lfs -text
51
+ *.tiff filter=lfs diff=lfs merge=lfs -text
52
+ # Image files - compressed
53
+ *.jpg filter=lfs diff=lfs merge=lfs -text
54
+ *.jpeg filter=lfs diff=lfs merge=lfs -text
55
+ *.webp filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,108 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - text-to-image
4
+ - stable-diffusion
5
+ - lora
6
+ - diffusers
7
+ - template:sd-lora
8
+ widget:
9
+ - text: >-
10
+ c0m1c style vintage comic cover of a psychic woman sitting at a covered red
11
+ table, in a haunting manor scene, the illustration style is macabre,
12
+ candles in the bacground over a mantle, the psychic is hovering her hands
13
+ over a purple crystal ball. Title test reads "Tales from the Flux" in an
14
+ eerie type face. In the lower corner show a price of 15 cents and the date
15
+ SEP 2024
16
+ output:
17
+ url: images/ComfyUI_09868_.png
18
+ - text: >-
19
+ c0m1c style vintage 1930s style comic strip panel of a rich old man wearing
20
+ a top hat and dapper suit deep in thought, thinking with a thought bubble
21
+ that reads "No FLUX were given?"
22
+ output:
23
+ url: images/ComfyUI_temp_ipugi_00131_.png
24
+ - text: >-
25
+ c0m1c style comic book strip panel of two men having a staring contest in a
26
+ bar, pop art style, with the thought bubble sayings "Blink." and "You
27
+ first."
28
+ output:
29
+ url: images/ComfyUI_temp_ipugi_00079_.png
30
+ - text: >-
31
+ c0m1c style comic book strip panel of a glam 1980s superhero woman, with the
32
+ speech bubble saying "My spirit animal is a WiFi symbol!" purple wifi icon
33
+ on her chest
34
+ output:
35
+ url: images/ComfyUI_temp_ipugi_00071_.png
36
+ - text: >-
37
+ c0m1c style comic book strip 2 panels of a woman laughing hysterically,
38
+ 1950s living room. In the first panel one speech bubble "And then he said he
39
+ uses SD3!" over the head of a woman telling her friends a funny joke In
40
+ the second panel there are multiple speech bubbles over each woman's head
41
+ with the words "HAHA" in various ways, their heads are tilted back in heavy
42
+ laughter.
43
+ output:
44
+ url: images/ComfyUI_temp_ipugi_00085_.png
45
+ - text: >-
46
+ c0m1c style comic book strip panel of a woman in her living room glam style,
47
+ with the speech bubble saying "There's no place like latent space."
48
+ everything is pink including her dress
49
+ output:
50
+ url: images/ComfyUI_temp_ipugi_00076_.png
51
+ - text: >-
52
+ c0m1c style comic book strip panel of a superhero, with the speech bubble
53
+ saying "I am Captain Flux!" with a big black F emblem on his chest
54
+ output:
55
+ url: images/ComfyUI_temp_ipugi_00068_.png
56
+ - text: >-
57
+ c0m1c style comic strip panel of a pop art woman fashion model, side
58
+ profile, speech above says "OH FLUX!"
59
+ output:
60
+ url: images/ComfyUI_temp_ipugi_00040_.png
61
+ - text: >-
62
+ c0m1c style woman with red hair in a laundry room, vintage illustrated ad
63
+ for laundry detergent the brand name is FLUX in orange letters the
64
+ pre-heading above the logo reads "Where clean clothes meet clean pixels."
65
+ The woman is holding a laundry baskest with folded clothes and smiling in
66
+ bliss.
67
+ output:
68
+ url: images/ComfyUI_09863_.png
69
+ base_model: black-forest-labs/FLUX.1-dev
70
+ instance_prompt: c0m1c, comic book panel
71
+ license: creativeml-openrail-m
72
+ ---
73
+ # Retro Comic Flux
74
+
75
+ <Gallery />
76
+
77
+ ## Model description
78
+
79
+ Retro Comic Flux is a Flux LoRA trained on a dataset consisting entirely of public domain images manually sourced, cropped and enhanced. I used ~50 images 3 repeats 15 epochs and 0.0001 learning rate. These were all captioned using Joy Caption Batch.
80
+
81
+ This is very experimental and I had a difficult time sourcing high quality images of animals and vehicles in this style, so for now it&#39;s primarily good with human figures. It work best when you describe the character and a scene for a backdrop. It struggles with hands and eyes sometimes. If something is really not in the dataset it defaults to an ordinary AI illustration style.
82
+
83
+ USE DEIS SAMPLER FOR THE BEST RESULTS.
84
+
85
+ I used very similar settings as I have with my previous LoRAs so I won&#39;t go into detail for the sake of my time and brevity, low learning rates with less repeats and good data work best for simple styles.
86
+
87
+ I was careful in my selection of images and preprocessed each image in Photoshop to bring out vivid colors, reduce the yellowing and boost contrast. This helped me to maintain a consistent coloring and I believe it improved the training quality. When I did this I also removed the speech from speech bubbles from some of the training data for more flexibility and to help Flux understand context. You can explicitly state &quot;empty speech bubble&quot; in your prompts and it tends to work. If you want to dive in deeper try using an image captioner to describe a style you want to emulate, the images have rich captions and the model responds well to natural language.
88
+
89
+ Definitely expect a V2 of this LoRA soon, I have some ideas on how I can improve consistency but I need to find more varied source images.
90
+
91
+ If you enjoy this resource please send BUZZ ⚡️so I can keep experimenting and sharing. Please share your images in the gallery after downloading them, by sharing them in the gallery the system gives creators buzz to help with generating and training.
92
+
93
+ Trigger keyword: &#39;c0m1c&#39; &#39;comic book panel&#39;
94
+
95
+ Recommended strengths: 0.7 - 0.9
96
+
97
+ ## Trigger words
98
+
99
+ You should use `c0m1c` to trigger the image generation.
100
+
101
+ You should use `comic book panel` to trigger the image generation.
102
+
103
+
104
+ ## Download model
105
+
106
+ Weights for this model are available in Safetensors format.
107
+
108
+ [Download](/renderartist/retrocomicflux/tree/main) them in the Files & versions tab.