Dracones commited on
Commit
329d9e2
1 Parent(s): 74f8473

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +9 -24
README.md CHANGED
@@ -43,30 +43,15 @@ Below are the perplexity scores for the EXL2 models. A lower score is better.
43
 
44
  Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML and Chat-Vicuna prompt templates. A higher score is better.
45
 
46
-
47
- | Quant Size | Instruct Template | Score |
48
- |------------|-------------------|-------|
49
- | 8.0 | Alpaca | 75.02 |
50
- | 8.0 | ChatML | 73.82 |
51
- | 8.0 | Chat-Vicuna | 73.53 |
52
- | 7.0 | Alpaca | 74.96 |
53
- | 7.0 | ChatML | 74.22 |
54
- | 7.0 | Chat-Vicuna | 72.71 |
55
- | 6.0 | Alpaca | 75.11 |
56
- | 6.0 | ChatML | 74.29 |
57
- | 6.0 | Chat-Vicuna | 74.16 |
58
- | 5.0 | Alpaca | 74.11 |
59
- | 5.0 | ChatML | 72.74 |
60
- | 5.0 | Chat-Vicuna | 73.28 |
61
- | 4.5 | Alpaca | 73.18 |
62
- | 4.5 | ChatML | 73.62 |
63
- | 4.5 | Chat-Vicuna | 73.32 |
64
- | 4.0 | Alpaca | 71.85 |
65
- | 4.0 | ChatML | 73.99 |
66
- | 4.0 | Chat-Vicuna | 74.74 |
67
- | 3.5 | Alpaca | 73.73 |
68
- | 3.5 | ChatML | 72.07 |
69
- | 3.5 | Chat-Vicuna | 73.56 |
70
 
71
  ### Chat-Vicuna Template
72
 
 
43
 
44
  Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML and Chat-Vicuna prompt templates. A higher score is better.
45
 
46
+ | Quant Size | ChatML | Alpaca | Chat-Vicuna |
47
+ |------------|--------|--------|-------------|
48
+ | 8.0 | 73.82 | 75.02 | 73.53 |
49
+ | 7.0 | 74.22 | 74.96 | 72.71 |
50
+ | 6.0 | 74.29 | 75.11 | 74.16 |
51
+ | 5.0 | 72.74 | 74.11 | 73.28 |
52
+ | 4.5 | 73.62 | 73.18 | 73.32 |
53
+ | 4.0 | 73.99 | 71.85 | 74.74 |
54
+ | 3.5 | 72.07 | 73.73 | 73.56 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
 
56
  ### Chat-Vicuna Template
57