iamshnoo commited on
Commit
ca3a02c
1 Parent(s): 77d17eb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -1,6 +1,16 @@
1
  ---
2
  library_name: peft
 
 
 
 
 
3
  ---
 
 
 
 
 
4
  ## Training procedure
5
 
6
 
@@ -17,4 +27,4 @@ The following `bitsandbytes` quantization config was used during training:
17
  ### Framework versions
18
 
19
 
20
- - PEFT 0.4.0
 
1
  ---
2
  library_name: peft
3
+ license: cc-by-4.0
4
+ datasets:
5
+ - yahma/alpaca-cleaned
6
+ language:
7
+ - en
8
  ---
9
+
10
+ This represents the PEFT weights only. The base model is LLaMA 2 chat. Instruction finetuning was done using 4 bit QLoRA on a single A100 GPU with the PEFT config as given below. The dataset used for this instruction finetuning process is the cleaned alpaca dataset.
11
+
12
+ Do note that this model might have inferior performance on some specific tasks compared to full finetuning or a different base model trained with more specific data.
13
+
14
  ## Training procedure
15
 
16
 
 
27
  ### Framework versions
28
 
29
 
30
+ - PEFT 0.4.0