minimaxir commited on
Commit
eec139b
1 Parent(s): 59741e2

Notebook links

Browse files
Files changed (1) hide show
  1. README.md +7 -2
README.md CHANGED
@@ -50,12 +50,14 @@ base.load_lora_weights("minimaxir/sdxl-wrong-lora")
50
  _ = base.to("cuda")
51
  ```
52
 
53
- During inference, use `wrong` as the negative prompt.
54
 
55
  ## Examples
56
 
57
  **Left image** is the base model output (no LoRA) + refiner, **right image** is base (w/ LoRA) + refiner. Both generations use the same seed.
58
 
 
 
59
  `realistic human Shrek blogging at a computer workstation, hyperrealistic award-winning photo for vanity fair` (cfg = 13, seed = 56583700)
60
 
61
  ![](img/example1.webp)
@@ -80,8 +82,11 @@ During inference, use `wrong` as the negative prompt.
80
 
81
  The methodology and motivation for creating this LoRA is similar to my [wrong SD 2.0 textual inversion embedding](https://huggingface.co/minimaxir/wrong_embedding_sd_2_0) by training on a balanced variety of undesirable outputs, except trained as a LoRA since textual inversion with SDXL is complicated. The base images were generated from SDXL itself, with some prompt weighting to emphasize undesirable attributes for test images.
82
 
 
 
83
  ## Notes
84
 
85
- - The intuitive way to think about how this LoRA works is that on training start, it indicates an undersirable area of the vast highdimensional latent space which the rest of the diffusion process will move away from. This may work more effectively than textual inversion but more testing needs to be done.
 
86
  - It's possible to use `not wrong` in the normal prompt itself but in testing it has not much effect.
87
  - You can use other negative prompts in conjunction with the `wrong` prompt but you may want to weight them appropriately.
 
50
  _ = base.to("cuda")
51
  ```
52
 
53
+ During image generation, use `wrong` as the negative prompt.
54
 
55
  ## Examples
56
 
57
  **Left image** is the base model output (no LoRA) + refiner, **right image** is base (w/ LoRA) + refiner. Both generations use the same seed.
58
 
59
+ I have also [released a Colab Notebook](https://colab.research.google.com/github/minimaxir/sdxl-experiments/blob/main/sdxl_wrong_comparison.ipynb) to generate these kinds of images, although the seeds listed will not give the same results since they were generated on a different GPU/CUDA than the Colab notebook.
60
+
61
  `realistic human Shrek blogging at a computer workstation, hyperrealistic award-winning photo for vanity fair` (cfg = 13, seed = 56583700)
62
 
63
  ![](img/example1.webp)
 
82
 
83
  The methodology and motivation for creating this LoRA is similar to my [wrong SD 2.0 textual inversion embedding](https://huggingface.co/minimaxir/wrong_embedding_sd_2_0) by training on a balanced variety of undesirable outputs, except trained as a LoRA since textual inversion with SDXL is complicated. The base images were generated from SDXL itself, with some prompt weighting to emphasize undesirable attributes for test images.
84
 
85
+ You can see the code to generate the wrong images [in this Jupyter Notebook](https://github.com/minimaxir/sdxl-experiments/blob/main/wrong_image_generator.ipynb).
86
+
87
  ## Notes
88
 
89
+ - The intuitive way to think about how this LoRA works is that on training start, it indicates an undesirable area of the vast highdimensional latent space which the rest of the diffusion process will move away from. This may work more effectively than textual inversion but more testing needs to be done.
90
+ - The description of this LoRA is very careful to not state that the output is objectively _better_ than not using LoRA, because everything is subjective and there are use cases where vibrant output is not desired. For most use cases, the output should be better desired however.
91
  - It's possible to use `not wrong` in the normal prompt itself but in testing it has not much effect.
92
  - You can use other negative prompts in conjunction with the `wrong` prompt but you may want to weight them appropriately.