bhenrym14
/

airoboros-13b-gpt4-1.4.1-PI-8192-GPTQ

Text Generation

Model card Files Files and versions Community

bhenrym14 commited on Jul 6, 2023

Commit

147af85

·

1 Parent(s): 5db64ea

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ This is [Jon Durbin's Airoboros 13B GPT4 1.4](https://huggingface.co/jondurbin/a
 - Used airoboros-gpt4-1.4.1 dataset instead of airoboros-gpt4-1.4
 - **This is a QLoRA fine-tune**. The original 13b model is a full fine-tune.
-Otherwise, I emulated the training process as closely as possible (rank 64 QLoRA). It was trained on 1x RTX 6000 Ada for ~18 hours.
 ## How to Use
 The easiest way is to use [oobabooga text-generation-webui](https://github.com/oobabooga/text-generation-webui) with ExLlama. You'll need to set max_seq_len to 8192 and compress_pos_emb to 4.

 - Used airoboros-gpt4-1.4.1 dataset instead of airoboros-gpt4-1.4
 - **This is a QLoRA fine-tune**. The original 13b model is a full fine-tune.
+It was trained on 1x RTX 6000 Ada for ~18 hours.
 ## How to Use
 The easiest way is to use [oobabooga text-generation-webui](https://github.com/oobabooga/text-generation-webui) with ExLlama. You'll need to set max_seq_len to 8192 and compress_pos_emb to 4.