uttamg07 commited on
Commit
d1aa2f4
·
1 Parent(s): 8e451b3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -11,3 +11,23 @@ license: openrail
11
  ---
12
 
13
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  ---
12
 
13
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
14
+
15
+ # Fine-tuning [Stable Diffusion XL](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) for custom face and thumbs up gesture
16
+ Colab Notebook implementation of **LoRA** based Dreambooth technique, utilizing **Huggingface diffusers**, for fine-tuning the model to reliably predict thumbs up gesture with a custom face.
17
+
18
+ ## Datasets
19
+ Use the following links to download and view the thumbs-up and selfie images respectively
20
+ 1. [Thumbs Up](https://www.dropbox.com/scl/fi/yye56ojn7aebbdf45u1nb/thumbs_up.zip?rlkey=ixu3srz5ks2ybgzl0056xree1&dl=0)
21
+ 2. [Selfies](https://www.dropbox.com/scl/fi/8rdxsvyc3r6hf18b9u4gq/selfies.zip?rlkey=b7q6xn1wj90id2ix834wpwaa3&dl=0)
22
+
23
+ ## Checkpoints
24
+ 1. *lora-trained-thumbs-up-pw-0.5-steps-800* contains the weights for the model finetuned for the thumbs-up gesture
25
+ 2. *lora-trained-thumbs-up-pw-0.5-steps-800-uttam-pw-0.5-steps-1600* contains the weights for the model finetuned for the custom face
26
+
27
+ ## Results
28
+ Here are some of the quantitative results
29
+ ![](results/best_ug2146_simple.png)
30
+ *trigger keyword:* **a photo of ug2146 giving thumbs up**
31
+
32
+ ![](results/best_ug2146_joker.png)
33
+ *trigger keyword:* + **in a joker costume**