Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,119 @@
|
|
1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: creativeml-openrail-m
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
thumbnail: ""
|
5 |
+
tags:
|
6 |
+
- painting
|
7 |
+
- anime
|
8 |
+
- stable-diffusion
|
9 |
+
- aiart
|
10 |
+
- text-to-image
|
11 |
license: creativeml-openrail-m
|
12 |
---
|
13 |
+
<center><img src="https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion/resolve/main/img/5.jpg" width="512" height="512"/></center>
|
14 |
+
|
15 |
+
![visitors](https://visitor-badge.glitch.me/badge?page_id=DGspitzer_Art_Diffusion)
|
16 |
+
|
17 |
+
# DGSpitzer Art Diffusion
|
18 |
+
|
19 |
+
An AI model that generates cyberpunk anime characters!~
|
20 |
+
|
21 |
+
Based of a [Vintedois diffusion-v0-1 Model](https://huggingface.co/22h/vintedois-diffusion-v0-1/), training in Dreambooth
|
22 |
+
|
23 |
+
by [DGSpitzer](https://www.youtube.com/channel/UCzzsYBF4qwtMwJaPJZ5SuPg)
|
24 |
+
|
25 |
+
### 🧨 Diffusers
|
26 |
+
|
27 |
+
This repo contains both .ckpt and Diffuser model files. It's compatible to be used as any Stable Diffusion model, using standard [Stable Diffusion Pipelines](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
|
28 |
+
|
29 |
+
You can convert this model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX](https://huggingface.co/blog/stable_diffusion_jax).
|
30 |
+
|
31 |
+
```python example for loading the Diffuser
|
32 |
+
#!pip install diffusers transformers scipy torch
|
33 |
+
from diffusers import StableDiffusionPipeline
|
34 |
+
import torch
|
35 |
+
|
36 |
+
model_id = "DGSpitzer/DGSpitzer-Art-Diffusion"
|
37 |
+
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
|
38 |
+
pipe = pipe.to("cuda")
|
39 |
+
|
40 |
+
prompt = "a beautiful mech girl, painting style, 4k, photorealistic"
|
41 |
+
image = pipe(prompt).images[0]
|
42 |
+
|
43 |
+
image.save("./dgspitzer_ai_art.png")
|
44 |
+
```
|
45 |
+
|
46 |
+
# Online Demo
|
47 |
+
|
48 |
+
You can try the Online Web UI demo build with [Gradio](https://github.com/gradio-app/gradio), or use Colab Notebook at here:
|
49 |
+
|
50 |
+
*My Online Space Demo*
|
51 |
+
[![Open In Spaces](https://camo.githubusercontent.com/00380c35e60d6b04be65d3d94a58332be5cc93779f630bcdfc18ab9a3a7d3388/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f25463025394625413425393725323048756767696e67253230466163652d5370616365732d626c7565)](https://huggingface.co/spaces/DGSpitzer/DGS-Diffusion-Space)
|
52 |
+
|
53 |
+
*Finetuned Diffusion WebUI Demo by anzorq*
|
54 |
+
[![Use Finetuned_Diffusion WebUI](https://camo.githubusercontent.com/00380c35e60d6b04be65d3d94a58332be5cc93779f630bcdfc18ab9a3a7d3388/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f25463025394625413425393725323048756767696e67253230466163652d5370616365732d626c7565)](https://huggingface.co/spaces/anzorq/finetuned_diffusion)
|
55 |
+
|
56 |
+
*Colab Notebook*
|
57 |
+
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/HelixNGC7293/cyberpunk-anime-diffusion/blob/main/cyberpunk_anime_diffusion.ipynb)[![GitHub](https://badgen.net/badge/icon/Github?icon=github&label)](https://github.com/HelixNGC7293/cyberpunk-anime-diffusion)
|
58 |
+
|
59 |
+
*Buy me a coffee if you like this project ;P ♥*
|
60 |
+
[![Buy me a coffee](https://badgen.net/badge/icon/Buy%20Me%20A%20Coffee?icon=buymeacoffee&label)](https://www.buymeacoffee.com/dgspitzer)
|
61 |
+
|
62 |
+
<center><img src="https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion/resolve/main/img/1.jpg" width="512" height="512"/></center>
|
63 |
+
|
64 |
+
# **👇Model👇**
|
65 |
+
|
66 |
+
AI Model Weights available at huggingface: https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion
|
67 |
+
|
68 |
+
<center><img src="https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion/resolve/main/img/2.jpg" width="512" height="512"/></center>
|
69 |
+
|
70 |
+
# Usage
|
71 |
+
|
72 |
+
After model loaded, use keyword **dgs** in your prompt, with **illustration style** to get even better results.
|
73 |
+
|
74 |
+
For sampler, use **Euler A** for the best result (**DDIM** kinda works too), CFG Scale 7, steps 20 should be fine
|
75 |
+
|
76 |
+
**Example 1:**
|
77 |
+
|
78 |
+
```
|
79 |
+
portrait of a girl in dgs illustration style, Anime girl, female soldier working in a cyberpunk city, cleavage, ((perfect femine face)), intricate, 8k, highly detailed, shy, digital painting, intense, sharp focus
|
80 |
+
```
|
81 |
+
|
82 |
+
For cyber robot male character, you can add **muscular male** to improve the output.
|
83 |
+
|
84 |
+
**Example 2:**
|
85 |
+
|
86 |
+
```
|
87 |
+
a photo of muscular beard soldier male in dgs illustration style, half-body, holding robot arms, strong chest
|
88 |
+
```
|
89 |
+
|
90 |
+
**Example 3 (with Stable Diffusion WebUI):**
|
91 |
+
|
92 |
+
If using [AUTOMATIC1111's Stable Diffusion WebUI](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
|
93 |
+
|
94 |
+
You can simply use this as **prompt** with **Euler A** Sampler, CFG Scale 7, steps 20, 704 x 704px output res:
|
95 |
+
|
96 |
+
```
|
97 |
+
an anime girl in dgs illustration style
|
98 |
+
```
|
99 |
+
|
100 |
+
And set the **negative prompt** as this to get cleaner face:
|
101 |
+
|
102 |
+
```
|
103 |
+
out of focus, scary, creepy, evil, disfigured, missing limbs, ugly, gross, missing fingers
|
104 |
+
```
|
105 |
+
|
106 |
+
This will give you the exactly same style as the sample images above.
|
107 |
+
|
108 |
+
<center><img src="https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion/resolve/main/img/ReadmeAddon.jpg" width="256" height="353"/></center>
|
109 |
+
|
110 |
+
---
|
111 |
+
|
112 |
+
**NOTE: usage of this model implies accpetance of stable diffusion's [CreativeML Open RAIL-M license](LICENSE)**
|
113 |
+
|
114 |
+
---
|
115 |
+
|
116 |
+
|
117 |
+
<center><img src="https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion/resolve/main/img/4.jpg" width="700" height="700"/></center>
|
118 |
+
|
119 |
+
<center><img src="https://huggingface.co/DGSpitzer/Cyberpunk-Anime-Diffusion/resolve/main/img/6.jpg" width="700" height="700"/></center>
|