Update README.md
Browse files
README.md
CHANGED
@@ -5,4 +5,63 @@ tags:
|
|
5 |
- Controlnet
|
6 |
- Tile
|
7 |
- stable diffustion
|
8 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
- Controlnet
|
6 |
- Tile
|
7 |
- stable diffustion
|
8 |
+
---
|
9 |
+
# Model Card for Model ID
|
10 |
+
|
11 |
+
<!-- Provide a quick summary of what the model is/does. -->
|
12 |
+
|
13 |
+
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
14 |
+
|
15 |
+
## Model Details
|
16 |
+
|
17 |
+
### Model Description
|
18 |
+
|
19 |
+
<!-- Provide a longer summary of what this model is. -->
|
20 |
+
This is a SDXL based controlnet Tile model, trained with huggingface diffusers sets, fit for Stable diffusion SDXL controlnet.
|
21 |
+
It is oringal trained for my own realistic model used for Ultimate upscale process to boost the picture details. with a proper workflow, it can provide a good result for high detailed, high resolution image fix.
|
22 |
+
|
23 |
+
|
24 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/ddFT3326ddNOWBeoFnfZl.png)
|
25 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/OETMPhSCVEKdyUvILMsyp.png)
|
26 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/lznGyTnKy91AwRmSaCxTF.png)
|
27 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/iokmuDnYy7UC47t7AoLc1.png)
|
28 |
+
|
29 |
+
|
30 |
+
- **Developed by:** TTPlanet
|
31 |
+
- **Model type:** Controlnet Tile
|
32 |
+
- **Language(s) (NLP):** No language limitation
|
33 |
+
|
34 |
+
|
35 |
+
## Uses
|
36 |
+
Important: Tile model is not a upscale model!!! it enhance the detial of the oringal size image, remember this before you use it!
|
37 |
+
This model will not significant change the base model style. it only adding the fetures to the upscaled pixel blocks....
|
38 |
+
--Just use a regular controlnet model in Webui by select as tile model and use tile_resample for Ultimate Upscale script.
|
39 |
+
--Just use load controlnet model in comfyui and apply to control net condition.
|
40 |
+
--Try to use it in webui t2i, need proper prompt setup, otherwise it will significant modify the original image color. I don't know the reason, as I don't really use this function.
|
41 |
+
it do perform much better with the image from the datasets. However, everything works fine for the i2i model and what is the place usually the ultimate upscale is applied!!
|
42 |
+
--Please also notice this is a realistic training set, so no comic, animation application are promised.
|
43 |
+
--For tile upscale, set the denoise around 0.3-0.4 to get good result.
|
44 |
+
--For controlnet strengh, set to 0.9 will be better choice
|
45 |
+
--For human image fix, IPA and early stop on controlnet will provide better reslut
|
46 |
+
--Pickup a good realistic base model is important!
|
47 |
+
|
48 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/1xdkjCQ1rR2GryBkU1zxx.png)
|
49 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/MGSppLrJ4f15fisL-dnf0.png)
|
50 |
+
|
51 |
+
|
52 |
+
|
53 |
+
## Bias, Risks, and Limitations
|
54 |
+
|
55 |
+
No commercial USE!!!!
|
56 |
+
|
57 |
+
|
58 |
+
### Recommendations
|
59 |
+
|
60 |
+
Use comfyui to build your own Upscale process, it works fine!!!
|
61 |
+
|
62 |
+
Special thanks to the Controlnet builder lllyasviel Lvmin Zhang (Lyumin Zhang) who bring so much fun to us, and thanks huggingface make the training set to make the training so smooth.
|
63 |
+
|
64 |
+
|
65 |
+
## Model Card Contact
|
66 |
+
|
67 |
+
contact me if you want
|