jkeisling commited on
Commit
8b71872
1 Parent(s): 320b7ff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +76 -3
README.md CHANGED
@@ -1,3 +1,76 @@
1
- ---
2
- license: cc-by-nc-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - text-to-speech
4
+ license: cc-by-nc-sa-4.0
5
+ language:
6
+ - zh
7
+ - en
8
+ - de
9
+ - ja
10
+ - fr
11
+ - es
12
+ - ko
13
+ - ar
14
+ - nl
15
+ - ru
16
+ - it
17
+ - pl
18
+ - pt
19
+ pipeline_tag: text-to-speech
20
+ inference: false
21
+ ---
22
+
23
+
24
+ This is a reformat of the [official Fish Speech v1.5 weights](https://huggingface.co/fishaudio/fish-speech-1.5) to work with [fish-speech.rs](https://github.com/EndlessReform/fish-speech.rs/tree/main).
25
+
26
+ I've made the following changes, for better compatibility with [Candle.rs](https://github.com/huggingface/candle) and the HuggingFace ecosystem:
27
+ - DualAR transformer weights converted to `.safetensors` for safety and easier loading
28
+ - Tokenizer ported from [Tiktoken](https://github.com/openai/tiktoken) format and [custom wrapper](https://github.com/fishaudio/fish-speech/pull/696/files#diff-0db124559777c2399fda2a45cff039afa7eb1a53f2f98f628b02862c10b339ef) to HuggingFace Tokenizers for easier downstream use
29
+ - VQGAN is unchanged from v1.4, so copying the weight-norm merged safetensors and FireflyGAN config from [my previous conversion](https://huggingface.co/jkeisling/fish-speech-1.4)
30
+
31
+ NOTE:
32
+ - Please respect the original license and do not use this model for commercial purposes. You can support Fish Audio by using the official API at [fish.audio](https://fish.audio/auth/).
33
+ - These weights WILL NOT work with the [official Fish Speech inference code](https://github.com/fishaudio/fish-speech)!
34
+
35
+ ---
36
+ # ORIGINAL README: Fish Speech V1.5
37
+
38
+ **Fish Speech V1.5** is a leading text-to-speech (TTS) model trained on more than 1 million hours of audio data in multiple languages.
39
+
40
+ Supported languages:
41
+ - English (en) >300k hours
42
+ - Chinese (zh) >300k hours
43
+ - Japanese (ja) >100k hours
44
+ - German (de) ~20k hours
45
+ - French (fr) ~20k hours
46
+ - Spanish (es) ~20k hours
47
+ - Korean (ko) ~20k hours
48
+ - Arabic (ar) ~20k hours
49
+ - Russian (ru) ~20k hours
50
+ - Dutch (nl) <10k hours
51
+ - Italian (it) <10k hours
52
+ - Polish (pl) <10k hours
53
+ - Portuguese (pt) <10k hours
54
+
55
+ Please refer to [Fish Speech Github](https://github.com/fishaudio/fish-speech) for more info.
56
+ Demo available at [Fish Audio](https://fish.audio/).
57
+
58
+ ## Citation
59
+
60
+ If you found this repository useful, please consider citing this work:
61
+
62
+ ```
63
+ @misc{fish-speech-v1.4,
64
+ title={Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesis},
65
+ author={Shijia Liao and Yuxuan Wang and Tianyu Li and Yifan Cheng and Ruoyi Zhang and Rongzhi Zhou and Yijin Xing},
66
+ year={2024},
67
+ eprint={2411.01156},
68
+ archivePrefix={arXiv},
69
+ primaryClass={cs.SD},
70
+ url={https://arxiv.org/abs/2411.01156},
71
+ }
72
+ ```
73
+
74
+ ## License
75
+
76
+ This model is permissively licensed under the BY-CC-NC-SA-4.0 license.