ZhifengKong commited on
Commit
904a0fb
1 Parent(s): 9f748f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -5
README.md CHANGED
@@ -1,5 +1,34 @@
1
- ---
2
- license: other
3
- license_name: other
4
- license_link: LICENSE
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Audio Flamingo
2
+
3
+ **Zhifeng Kong, Arushi Goel, Rohan Badlani, Wei Ping, Rafael Valle, Bryan Catanzaro**
4
+
5
+ This repo contains the model checkpoints of [Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities](https://arxiv.org/abs/2402.01831) (ICML 2024). Audio Flamingo is a novel audio-understanding language model with
6
+ - strong audio understanding abilities,
7
+ - the ability to quickly adapt to unseen tasks via in-context learning and retrieval, and
8
+ - strong multi-turn dialogue abilities.
9
+
10
+ We introduce a series of training techniques, architecture design, and data strategies to enhance our model with these abilities. Extensive evaluations across various audio understanding tasks confirm the efficacy of our method, setting new state-of-the-art benchmarks. Sound demos can be found in this [website](https://audioflamingo.github.io/).
11
+
12
+ ![](audio_flamingo_arch.png)
13
+
14
+ ## Code
15
+
16
+ Our code is at
17
+ ```
18
+ https://github.com/NVIDIA/audio-flamingo
19
+ ```
20
+
21
+ ## License
22
+
23
+ - The checkpoints are for non-commercial use only. They are subject to the [OPT-IML](https://huggingface.co/facebook/opt-iml-1.3b/blob/main/LICENSE.md) license, the [Terms of Use](https://openai.com/policies/terms-of-use) of the data generated by OpenAI, and the original licenses accompanying each training dataset.
24
+
25
+
26
+ ## Citation
27
+ ```
28
+ @article{kong2024audio,
29
+ title={Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities},
30
+ author={Kong, Zhifeng and Goel, Arushi and Badlani, Rohan and Ping, Wei and Valle, Rafael and Catanzaro, Bryan},
31
+ journal={arXiv preprint arXiv:2402.01831},
32
+ year={2024}
33
+ }
34
+ ```