Update VRAM
Browse files
README.md
CHANGED
@@ -31,9 +31,9 @@ should probably proofread and complete it, then remove this comment. -->
|
|
31 |
|
32 |
# Whisper Large V2 zh-HK - Alvin
|
33 |
|
34 |
-
This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on the Common Voice 11.0 dataset. This is trained with PEFT LoRA+BNB INT8.
|
35 |
|
36 |
-
To use the model, use the following code. It should be able to inference with less than
|
37 |
```
|
38 |
from peft import PeftModel, PeftConfig
|
39 |
from transformers import WhisperForConditionalGeneration, Seq2SeqTrainer, WhisperTokenizer, WhisperProcessor
|
|
|
31 |
|
32 |
# Whisper Large V2 zh-HK - Alvin
|
33 |
|
34 |
+
This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on the Common Voice 11.0 dataset. This is trained with PEFT LoRA+BNB INT8 with a Normalized CER of 7.77%
|
35 |
|
36 |
+
To use the model, use the following code. It should be able to inference with less than 4GB VRAM (batch size of 1).
|
37 |
```
|
38 |
from peft import PeftModel, PeftConfig
|
39 |
from transformers import WhisperForConditionalGeneration, Seq2SeqTrainer, WhisperTokenizer, WhisperProcessor
|