Abhinav Kulkarni
commited on
Commit
•
6c4baf9
1
Parent(s):
1c58550
Updated README
Browse files
README.md
CHANGED
|
@@ -96,7 +96,11 @@ This evaluation was done using [LM-Eval](https://github.com/EleutherAI/lm-evalua
|
|
| 96 |
|
| 97 |
[vicuna-33b-v1.3](https://huggingface.co/lmsys/vicuna-33b-v1.3)
|
| 98 |
|
| 99 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 100 |
|
| 101 |
[vicuna-33b-v1.3 (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/lmsys-vicuna-33b-v1.3-w4-g128-awq)
|
| 102 |
|
|
|
|
| 96 |
|
| 97 |
[vicuna-33b-v1.3](https://huggingface.co/lmsys/vicuna-33b-v1.3)
|
| 98 |
|
| 99 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 100 |
+
|--------|------:|---------------|-----:|---|------|
|
| 101 |
+
|wikitext| 1|word_perplexity|9.8210| | |
|
| 102 |
+
| | |byte_perplexity|1.5330| | |
|
| 103 |
+
| | |bits_per_byte |0.6163| | |
|
| 104 |
|
| 105 |
[vicuna-33b-v1.3 (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/lmsys-vicuna-33b-v1.3-w4-g128-awq)
|
| 106 |
|