Amphion Text-to-Audio Pretrained Models

We provide the following pretrained checkpoints for you to use, specifically:

Two AudioLDM pretrained checkpoints with corresponding AutoencoderKL checkpoints trained on AudioCaps.

Quick Start

To utilize the pretrained models, just run the following commands:

git lfs install
git clone https://huggingface.co/amphion/text_to_audio

git clone https://github.com/open-mmlab/Amphion.git

Use the soft link to specify the downloaded checkpoint in the first step:

cd Amphion
mkdir -p ckpts
ln -s  ../../../text_to_speech/tta  ckpts/

You can follow the inference part of this recipe to generate audio from text.

We also provided an online demo, feel free to try it!