renderartist
commited on
Commit
•
20bf6f2
0
Parent(s):
initial commit
Browse files- .gitattributes +55 -0
- README.md +108 -0
.gitattributes
ADDED
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.lz4 filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
26 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
27 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
36 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
37 |
+
# Audio files - uncompressed
|
38 |
+
*.pcm filter=lfs diff=lfs merge=lfs -text
|
39 |
+
*.sam filter=lfs diff=lfs merge=lfs -text
|
40 |
+
*.raw filter=lfs diff=lfs merge=lfs -text
|
41 |
+
# Audio files - compressed
|
42 |
+
*.aac filter=lfs diff=lfs merge=lfs -text
|
43 |
+
*.flac filter=lfs diff=lfs merge=lfs -text
|
44 |
+
*.mp3 filter=lfs diff=lfs merge=lfs -text
|
45 |
+
*.ogg filter=lfs diff=lfs merge=lfs -text
|
46 |
+
*.wav filter=lfs diff=lfs merge=lfs -text
|
47 |
+
# Image files - uncompressed
|
48 |
+
*.bmp filter=lfs diff=lfs merge=lfs -text
|
49 |
+
*.gif filter=lfs diff=lfs merge=lfs -text
|
50 |
+
*.png filter=lfs diff=lfs merge=lfs -text
|
51 |
+
*.tiff filter=lfs diff=lfs merge=lfs -text
|
52 |
+
# Image files - compressed
|
53 |
+
*.jpg filter=lfs diff=lfs merge=lfs -text
|
54 |
+
*.jpeg filter=lfs diff=lfs merge=lfs -text
|
55 |
+
*.webp filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,108 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- text-to-image
|
4 |
+
- stable-diffusion
|
5 |
+
- lora
|
6 |
+
- diffusers
|
7 |
+
- template:sd-lora
|
8 |
+
widget:
|
9 |
+
- text: >-
|
10 |
+
c0m1c style vintage comic cover of a psychic woman sitting at a covered red
|
11 |
+
table, in a haunting manor scene, the illustration style is macabre,
|
12 |
+
candles in the bacground over a mantle, the psychic is hovering her hands
|
13 |
+
over a purple crystal ball. Title test reads "Tales from the Flux" in an
|
14 |
+
eerie type face. In the lower corner show a price of 15 cents and the date
|
15 |
+
SEP 2024
|
16 |
+
output:
|
17 |
+
url: images/ComfyUI_09868_.png
|
18 |
+
- text: >-
|
19 |
+
c0m1c style vintage 1930s style comic strip panel of a rich old man wearing
|
20 |
+
a top hat and dapper suit deep in thought, thinking with a thought bubble
|
21 |
+
that reads "No FLUX were given?"
|
22 |
+
output:
|
23 |
+
url: images/ComfyUI_temp_ipugi_00131_.png
|
24 |
+
- text: >-
|
25 |
+
c0m1c style comic book strip panel of two men having a staring contest in a
|
26 |
+
bar, pop art style, with the thought bubble sayings "Blink." and "You
|
27 |
+
first."
|
28 |
+
output:
|
29 |
+
url: images/ComfyUI_temp_ipugi_00079_.png
|
30 |
+
- text: >-
|
31 |
+
c0m1c style comic book strip panel of a glam 1980s superhero woman, with the
|
32 |
+
speech bubble saying "My spirit animal is a WiFi symbol!" purple wifi icon
|
33 |
+
on her chest
|
34 |
+
output:
|
35 |
+
url: images/ComfyUI_temp_ipugi_00071_.png
|
36 |
+
- text: >-
|
37 |
+
c0m1c style comic book strip 2 panels of a woman laughing hysterically,
|
38 |
+
1950s living room. In the first panel one speech bubble "And then he said he
|
39 |
+
uses SD3!" over the head of a woman telling her friends a funny joke In
|
40 |
+
the second panel there are multiple speech bubbles over each woman's head
|
41 |
+
with the words "HAHA" in various ways, their heads are tilted back in heavy
|
42 |
+
laughter.
|
43 |
+
output:
|
44 |
+
url: images/ComfyUI_temp_ipugi_00085_.png
|
45 |
+
- text: >-
|
46 |
+
c0m1c style comic book strip panel of a woman in her living room glam style,
|
47 |
+
with the speech bubble saying "There's no place like latent space."
|
48 |
+
everything is pink including her dress
|
49 |
+
output:
|
50 |
+
url: images/ComfyUI_temp_ipugi_00076_.png
|
51 |
+
- text: >-
|
52 |
+
c0m1c style comic book strip panel of a superhero, with the speech bubble
|
53 |
+
saying "I am Captain Flux!" with a big black F emblem on his chest
|
54 |
+
output:
|
55 |
+
url: images/ComfyUI_temp_ipugi_00068_.png
|
56 |
+
- text: >-
|
57 |
+
c0m1c style comic strip panel of a pop art woman fashion model, side
|
58 |
+
profile, speech above says "OH FLUX!"
|
59 |
+
output:
|
60 |
+
url: images/ComfyUI_temp_ipugi_00040_.png
|
61 |
+
- text: >-
|
62 |
+
c0m1c style woman with red hair in a laundry room, vintage illustrated ad
|
63 |
+
for laundry detergent the brand name is FLUX in orange letters the
|
64 |
+
pre-heading above the logo reads "Where clean clothes meet clean pixels."
|
65 |
+
The woman is holding a laundry baskest with folded clothes and smiling in
|
66 |
+
bliss.
|
67 |
+
output:
|
68 |
+
url: images/ComfyUI_09863_.png
|
69 |
+
base_model: black-forest-labs/FLUX.1-dev
|
70 |
+
instance_prompt: c0m1c, comic book panel
|
71 |
+
license: creativeml-openrail-m
|
72 |
+
---
|
73 |
+
# Retro Comic Flux
|
74 |
+
|
75 |
+
<Gallery />
|
76 |
+
|
77 |
+
## Model description
|
78 |
+
|
79 |
+
Retro Comic Flux is a Flux LoRA trained on a dataset consisting entirely of public domain images manually sourced, cropped and enhanced. I used ~50 images 3 repeats 15 epochs and 0.0001 learning rate. These were all captioned using Joy Caption Batch.
|
80 |
+
|
81 |
+
This is very experimental and I had a difficult time sourcing high quality images of animals and vehicles in this style, so for now it's primarily good with human figures. It work best when you describe the character and a scene for a backdrop. It struggles with hands and eyes sometimes. If something is really not in the dataset it defaults to an ordinary AI illustration style.
|
82 |
+
|
83 |
+
USE DEIS SAMPLER FOR THE BEST RESULTS.
|
84 |
+
|
85 |
+
I used very similar settings as I have with my previous LoRAs so I won't go into detail for the sake of my time and brevity, low learning rates with less repeats and good data work best for simple styles.
|
86 |
+
|
87 |
+
I was careful in my selection of images and preprocessed each image in Photoshop to bring out vivid colors, reduce the yellowing and boost contrast. This helped me to maintain a consistent coloring and I believe it improved the training quality. When I did this I also removed the speech from speech bubbles from some of the training data for more flexibility and to help Flux understand context. You can explicitly state "empty speech bubble" in your prompts and it tends to work. If you want to dive in deeper try using an image captioner to describe a style you want to emulate, the images have rich captions and the model responds well to natural language.
|
88 |
+
|
89 |
+
Definitely expect a V2 of this LoRA soon, I have some ideas on how I can improve consistency but I need to find more varied source images.
|
90 |
+
|
91 |
+
If you enjoy this resource please send BUZZ ⚡️so I can keep experimenting and sharing. Please share your images in the gallery after downloading them, by sharing them in the gallery the system gives creators buzz to help with generating and training.
|
92 |
+
|
93 |
+
Trigger keyword: 'c0m1c' 'comic book panel'
|
94 |
+
|
95 |
+
Recommended strengths: 0.7 - 0.9
|
96 |
+
|
97 |
+
## Trigger words
|
98 |
+
|
99 |
+
You should use `c0m1c` to trigger the image generation.
|
100 |
+
|
101 |
+
You should use `comic book panel` to trigger the image generation.
|
102 |
+
|
103 |
+
|
104 |
+
## Download model
|
105 |
+
|
106 |
+
Weights for this model are available in Safetensors format.
|
107 |
+
|
108 |
+
[Download](/renderartist/retrocomicflux/tree/main) them in the Files & versions tab.
|