ClaireOzzz
commited on
Commit
•
305003b
1
Parent(s):
fbb8a30
Update README.md
Browse files
README.md
CHANGED
@@ -11,4 +11,52 @@ pinned: false
|
|
11 |
suggested_hardware: "a10g-small"
|
12 |
---
|
13 |
|
14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
suggested_hardware: "a10g-small"
|
12 |
---
|
13 |
|
14 |
+
tags:
|
15 |
+
- text-to-image
|
16 |
+
- creative
|
17 |
+
- control-image
|
18 |
+
- stable-diffusion
|
19 |
+
- pinned: false
|
20 |
+
datasets:
|
21 |
+
- ClaireOzzz/All_Images
|
22 |
+
- ClaireOzzz/Porcelain
|
23 |
+
|
24 |
+
---
|
25 |
+
|
26 |
+
# SUTDxSUNS Spatial Project: A 2.5D Control Generator
|
27 |
+
|
28 |
+
![image/png](https://github.com/ClaireOzzz/ImageURLhost/blob/main/Prototype%20Tests.png?raw=true)
|
29 |
+
|
30 |
+
## Status
|
31 |
+
|
32 |
+
Currently ongoing - will be completed by the 17th of December
|
33 |
+
|
34 |
+
## Demo
|
35 |
+
|
36 |
+
Try out the prototype on [COLAB](https://colab.research.google.com/drive/18FBtOWcf9jgLGV-p-ATPNtCHus2yWe-W?usp=sharing)
|
37 |
+
|
38 |
+
## Project Description
|
39 |
+
|
40 |
+
This project was for a short-term design studio that required applied deep learning and linking of existing models for spatial design. Special thanks to SUNS for providing us with data.
|
41 |
+
The controlnet training model and generation code is credited to fffiloni, while the depthmap generation to GLTF model is credited to Radamés Ajna.
|
42 |
+
|
43 |
+
[Training model](https://huggingface.co/spaces/fffiloni/train-dreambooth-lora-sdxl)
|
44 |
+
[Generation model](https://huggingface.co/spaces/fffiloni/sdxl-control-loras)
|
45 |
+
[3D Depth model](https://huggingface.co/spaces/radames/dpt-depth-estimation-3d-obj)
|
46 |
+
|
47 |
+
## Pipeline
|
48 |
+
|
49 |
+
![image/png](https://github.com/ClaireOzzz/ImageURLhost/blob/main/New%20Pipeline.png?raw=true)
|
50 |
+
|
51 |
+
|
52 |
+
### Key Features
|
53 |
+
|
54 |
+
- **User-Friendly Training Interface for non-developers**
|
55 |
+
-
|
56 |
+
- **Text-to-Image Generation with control**
|
57 |
+
|
58 |
+
- **Specific Training Data**
|
59 |
+
|
60 |
+
- **2.5D Visualisation** B
|
61 |
+
|
62 |
+
|