Update README.md
Browse files
README.md
CHANGED
@@ -20,6 +20,27 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
20 |
<a href='https://huggingface.co/BadToBest/EchoMimic'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
|
21 |
</div>
|
22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
## Gallery
|
24 |
### Audio Driven (Sing)
|
25 |
|
@@ -113,14 +134,6 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
113 |
|
114 |
**οΌSome demo images above are sourced from image websites. If there is any infringement, we will immediately remove them and apologize.οΌ**
|
115 |
|
116 |
-
## Acknowledgements
|
117 |
-
|
118 |
-
We would like to thank the contributors to the [AnimateDiff](https://github.com/guoyww/AnimateDiff), [Moore-AnimateAnyone](https://github.com/MooreThreads/Moore-AnimateAnyone) and [MuseTalk](https://github.com/TMElyralab/MuseTalk) repositories, for their open research and exploration.
|
119 |
-
|
120 |
-
We are also grateful to [V-Express](https://github.com/tencent-ailab/V-Express) and [hallo](https://github.com/fudan-generative-vision/hallo) for their outstanding work in the area of diffusion-based talking heads.
|
121 |
-
|
122 |
-
If we missed any open-source projects or related articles, we would like to complement the acknowledgement of this specific work immediately.
|
123 |
-
|
124 |
## Citation
|
125 |
|
126 |
If you find our work useful for your research, please consider citing the paper:
|
|
|
20 |
<a href='https://huggingface.co/BadToBest/EchoMimic'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
|
21 |
</div>
|
22 |
|
23 |
+
## Model Files
|
24 |
+
|
25 |
+
```
|
26 |
+
./pretrained_models/
|
27 |
+
βββ denoising_unet.pth
|
28 |
+
βββ reference_unet.pth
|
29 |
+
βββ motion_module.pth
|
30 |
+
βββ face_locator.pth
|
31 |
+
βββ sd-vae-ft-mse
|
32 |
+
β βββ ...
|
33 |
+
βββ sd-image-variations-diffusers
|
34 |
+
β βββ ...
|
35 |
+
βββ audio_processor
|
36 |
+
βββ whisper_tiny.pt
|
37 |
+
```
|
38 |
+
|
39 |
+
Some models in this hub can be directly downloaded from it's original hub:
|
40 |
+
- [sd-vae-ft-mse](https://huggingface.co/stabilityai/sd-vae-ft-mse): Weights are intended to be used with the diffusers library. (_Thanks to [stablilityai](https://huggingface.co/stabilityai)_)
|
41 |
+
- [sd-image-variations-diffusers](https://huggingface.co/lambdalabs/sd-image-variations-diffusers)
|
42 |
+
- [audio_processor](https://openaipublic.azureedge.net/main/whisper/models/65147644a518d12f04e32d6f3b26facc3f8dd46e5390956a9424a650c0ce22b9/tiny.pt)
|
43 |
+
|
44 |
## Gallery
|
45 |
### Audio Driven (Sing)
|
46 |
|
|
|
134 |
|
135 |
**οΌSome demo images above are sourced from image websites. If there is any infringement, we will immediately remove them and apologize.οΌ**
|
136 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
137 |
## Citation
|
138 |
|
139 |
If you find our work useful for your research, please consider citing the paper:
|