Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
@@ -11,3 +11,23 @@ license: openrail
|
|
11 |
---
|
12 |
|
13 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
---
|
12 |
|
13 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
14 |
+
|
15 |
+
# Fine-tuning [Stable Diffusion XL](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) for custom face and thumbs up gesture
|
16 |
+
Colab Notebook implementation of **LoRA** based Dreambooth technique, utilizing **Huggingface diffusers**, for fine-tuning the model to reliably predict thumbs up gesture with a custom face.
|
17 |
+
|
18 |
+
## Datasets
|
19 |
+
Use the following links to download and view the thumbs-up and selfie images respectively
|
20 |
+
1. [Thumbs Up](https://www.dropbox.com/scl/fi/yye56ojn7aebbdf45u1nb/thumbs_up.zip?rlkey=ixu3srz5ks2ybgzl0056xree1&dl=0)
|
21 |
+
2. [Selfies](https://www.dropbox.com/scl/fi/8rdxsvyc3r6hf18b9u4gq/selfies.zip?rlkey=b7q6xn1wj90id2ix834wpwaa3&dl=0)
|
22 |
+
|
23 |
+
## Checkpoints
|
24 |
+
1. *lora-trained-thumbs-up-pw-0.5-steps-800* contains the weights for the model finetuned for the thumbs-up gesture
|
25 |
+
2. *lora-trained-thumbs-up-pw-0.5-steps-800-uttam-pw-0.5-steps-1600* contains the weights for the model finetuned for the custom face
|
26 |
+
|
27 |
+
## Results
|
28 |
+
Here are some of the quantitative results
|
29 |
+
![](results/best_ug2146_simple.png)
|
30 |
+
*trigger keyword:* **a photo of ug2146 giving thumbs up**
|
31 |
+
|
32 |
+
![](results/best_ug2146_joker.png)
|
33 |
+
*trigger keyword:* + **in a joker costume**
|