Update README.md
Browse files
README.md
CHANGED
@@ -17,3 +17,64 @@ widget:
|
|
17 |
license: gpl-3.0
|
18 |
---
|
19 |
<Gallery />
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
license: gpl-3.0
|
18 |
---
|
19 |
<Gallery />
|
20 |
+
## BitDiffusionV0.1
|
21 |
+
|
22 |
+
This is the initial version of the image model trained on the Bittensor network within subnet 17. It's not expected for this model to perform as well as MidJourney V6 at the moment. However, it does generate better images than base SDXL model.
|
23 |
+
|
24 |
+
**Trained on the dataset of Subnet 19 Vision.**
|
25 |
+
|
26 |
+
## Settings for BitDiffusionV0.1
|
27 |
+
|
28 |
+
Use these settings for the best results with BitDiffusionV0.1:
|
29 |
+
|
30 |
+
CFG Scale: Use a CFG scale of 8
|
31 |
+
|
32 |
+
Steps: 40 to 60 steps
|
33 |
+
|
34 |
+
Sampler: DPM++ 2M SDE
|
35 |
+
|
36 |
+
Scheduler: Karras
|
37 |
+
|
38 |
+
Resolution: 1024x1024
|
39 |
+
|
40 |
+
## Use it with 🧨 diffusers
|
41 |
+
```python
|
42 |
+
import torch
|
43 |
+
from diffusers import (
|
44 |
+
StableDiffusionXLPipeline,
|
45 |
+
KDPM2AncestralDiscreteScheduler,
|
46 |
+
AutoencoderKL
|
47 |
+
)
|
48 |
+
|
49 |
+
# Load VAE component
|
50 |
+
vae = AutoencoderKL.from_pretrained(
|
51 |
+
"madebyollin/sdxl-vae-fp16-fix",
|
52 |
+
torch_dtype=torch.float16
|
53 |
+
)
|
54 |
+
|
55 |
+
# Configure the pipeline
|
56 |
+
pipe = StableDiffusionXLPipeline.from_pretrained(
|
57 |
+
"PlixAI/BitDiffusionV0.1",
|
58 |
+
vae=vae,
|
59 |
+
torch_dtype=torch.float16
|
60 |
+
)
|
61 |
+
pipe.scheduler = KDPM2AncestralDiscreteScheduler.from_config(pipe.scheduler.config)
|
62 |
+
pipe.to('cuda')
|
63 |
+
|
64 |
+
# Define prompts and generate image
|
65 |
+
prompt = "black fluffy gorgeous dangerous cat animal creature, large orange eyes, big fluffy ears, piercing gaze, full moon, dark ambiance, best quality, extremely detailed"
|
66 |
+
negative_prompt = "nsfw, bad quality, bad anatomy, worst quality, low quality, low resolutions, extra fingers, blur, blurry, ugly, wrongs proportions, watermark, image artifacts, lowres, ugly, jpeg artifacts, deformed, noisy image"
|
67 |
+
|
68 |
+
image = pipe(
|
69 |
+
prompt,
|
70 |
+
negative_prompt=negative_prompt,
|
71 |
+
width=1024,
|
72 |
+
height=1024,
|
73 |
+
guidance_scale=7.5,
|
74 |
+
num_inference_steps=50
|
75 |
+
).images[0]
|
76 |
+
```
|
77 |
+
|
78 |
+
https://github.com/namoray/vision
|
79 |
+
|
80 |
+
https://github.com/PlixML/pixel
|