minor edits
Browse files
README.md
CHANGED
@@ -19,6 +19,7 @@ Benefits of using this LoRA:
|
|
19 |
- Higher color saturation and vibrance
|
20 |
- Higher detail in textures/fabrics
|
21 |
- Higher sharpness for blurry/background objects
|
|
|
22 |
- Less likely to have random artifacts
|
23 |
- Appears to allow the model to follow the input prompt with a more expected behavior
|
24 |
|
@@ -30,7 +31,10 @@ The LoRA can be loaded using `load_lora_weights` like any other LoRA in `diffuse
|
|
30 |
import torch
|
31 |
from diffusers import DiffusionPipeline, AutoencoderKL
|
32 |
|
33 |
-
vae = AutoencoderKL.from_pretrained(
|
|
|
|
|
|
|
34 |
base = DiffusionPipeline.from_pretrained(
|
35 |
"stabilityai/stable-diffusion-xl-base-1.0",
|
36 |
vae=vae,
|
@@ -44,7 +48,7 @@ base.load_lora_weights("minimaxir/sdxl-wrong-lora")
|
|
44 |
_ = base.to("cuda")
|
45 |
```
|
46 |
|
47 |
-
During inference, use `wrong` as the
|
48 |
|
49 |
## Examples
|
50 |
|
@@ -52,9 +56,10 @@ Left is the base model output (no LoRA) + refiner, right is base + LoRA and refi
|
|
52 |
|
53 |
## Methodology
|
54 |
|
55 |
-
The methodology for creating this LoRA is similar to my [wrong SD 2.0 textual inversion embedding](https://huggingface.co/minimaxir/wrong_embedding_sd_2_0), except trained as a LoRA since textual inversion on SDXL is complicated. The base images were generated from SDXL itself.
|
56 |
|
57 |
## Notes
|
58 |
|
|
|
59 |
- It's possible to use `not wrong` in the prompt itself but in testing it has no effect.
|
60 |
-
- You can use other negative prompts in conjunction with the `wrong` prompt but you may want to weight them.
|
|
|
19 |
- Higher color saturation and vibrance
|
20 |
- Higher detail in textures/fabrics
|
21 |
- Higher sharpness for blurry/background objects
|
22 |
+
- Better at anatomically-correct hands
|
23 |
- Less likely to have random artifacts
|
24 |
- Appears to allow the model to follow the input prompt with a more expected behavior
|
25 |
|
|
|
31 |
import torch
|
32 |
from diffusers import DiffusionPipeline, AutoencoderKL
|
33 |
|
34 |
+
vae = AutoencoderKL.from_pretrained(
|
35 |
+
"madebyollin/sdxl-vae-fp16-fix",
|
36 |
+
torch_dtype=torch.float16
|
37 |
+
)
|
38 |
base = DiffusionPipeline.from_pretrained(
|
39 |
"stabilityai/stable-diffusion-xl-base-1.0",
|
40 |
vae=vae,
|
|
|
48 |
_ = base.to("cuda")
|
49 |
```
|
50 |
|
51 |
+
During inference, use `wrong` as the negative prompt.
|
52 |
|
53 |
## Examples
|
54 |
|
|
|
56 |
|
57 |
## Methodology
|
58 |
|
59 |
+
The methodology and motivation for creating this LoRA is similar to my [wrong SD 2.0 textual inversion embedding](https://huggingface.co/minimaxir/wrong_embedding_sd_2_0) by training on a balanced variety of undesirable outputs, except trained as a LoRA since textual inversion on SDXL is complicated. The base images were generated from SDXL itself, with some prompt weighting to emphasize undesirable attributes for test images.
|
60 |
|
61 |
## Notes
|
62 |
|
63 |
+
- The intuitive way to think about how this LoRA works
|
64 |
- It's possible to use `not wrong` in the prompt itself but in testing it has no effect.
|
65 |
+
- You can use other negative prompts in conjunction with the `wrong` prompt but you may want to weight them appropriately.
|