minimaxir commited on
Commit
7f3f245
1 Parent(s): b9090f5

minor edits

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -19,6 +19,7 @@ Benefits of using this LoRA:
19
  - Higher color saturation and vibrance
20
  - Higher detail in textures/fabrics
21
  - Higher sharpness for blurry/background objects
 
22
  - Less likely to have random artifacts
23
  - Appears to allow the model to follow the input prompt with a more expected behavior
24
 
@@ -30,7 +31,10 @@ The LoRA can be loaded using `load_lora_weights` like any other LoRA in `diffuse
30
  import torch
31
  from diffusers import DiffusionPipeline, AutoencoderKL
32
 
33
- vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16)
 
 
 
34
  base = DiffusionPipeline.from_pretrained(
35
  "stabilityai/stable-diffusion-xl-base-1.0",
36
  vae=vae,
@@ -44,7 +48,7 @@ base.load_lora_weights("minimaxir/sdxl-wrong-lora")
44
  _ = base.to("cuda")
45
  ```
46
 
47
- During inference, use `wrong` as the sole negative prompt.
48
 
49
  ## Examples
50
 
@@ -52,9 +56,10 @@ Left is the base model output (no LoRA) + refiner, right is base + LoRA and refi
52
 
53
  ## Methodology
54
 
55
- The methodology for creating this LoRA is similar to my [wrong SD 2.0 textual inversion embedding](https://huggingface.co/minimaxir/wrong_embedding_sd_2_0), except trained as a LoRA since textual inversion on SDXL is complicated. The base images were generated from SDXL itself.
56
 
57
  ## Notes
58
 
 
59
  - It's possible to use `not wrong` in the prompt itself but in testing it has no effect.
60
- - You can use other negative prompts in conjunction with the `wrong` prompt but you may want to weight them.
 
19
  - Higher color saturation and vibrance
20
  - Higher detail in textures/fabrics
21
  - Higher sharpness for blurry/background objects
22
+ - Better at anatomically-correct hands
23
  - Less likely to have random artifacts
24
  - Appears to allow the model to follow the input prompt with a more expected behavior
25
 
 
31
  import torch
32
  from diffusers import DiffusionPipeline, AutoencoderKL
33
 
34
+ vae = AutoencoderKL.from_pretrained(
35
+ "madebyollin/sdxl-vae-fp16-fix",
36
+ torch_dtype=torch.float16
37
+ )
38
  base = DiffusionPipeline.from_pretrained(
39
  "stabilityai/stable-diffusion-xl-base-1.0",
40
  vae=vae,
 
48
  _ = base.to("cuda")
49
  ```
50
 
51
+ During inference, use `wrong` as the negative prompt.
52
 
53
  ## Examples
54
 
 
56
 
57
  ## Methodology
58
 
59
+ The methodology and motivation for creating this LoRA is similar to my [wrong SD 2.0 textual inversion embedding](https://huggingface.co/minimaxir/wrong_embedding_sd_2_0) by training on a balanced variety of undesirable outputs, except trained as a LoRA since textual inversion on SDXL is complicated. The base images were generated from SDXL itself, with some prompt weighting to emphasize undesirable attributes for test images.
60
 
61
  ## Notes
62
 
63
+ - The intuitive way to think about how this LoRA works
64
  - It's possible to use `not wrong` in the prompt itself but in testing it has no effect.
65
+ - You can use other negative prompts in conjunction with the `wrong` prompt but you may want to weight them appropriately.